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PllEFACK 

The pni’iHj.sc! of this vdluiiu! is to make avuilahlo Hit* i psiilts (»f work that 
has ticpn done (hiring tlic past decwle in tha Psyflioinetria Laboratory at 
the I’liiversily of (’liicaKfj, The nialerial is presented in the ffirm of a text 
for students. Jwentially all the material <if the first edition, Thv Vrchm of 
Mind, has l>een retained Ins-e, and mneh has been iidiled Imth in tnnltiide- 
faetor theory and in eomputational method. Detailed computationul tdllee 
routine ba.s not been featured bm*an.se it will be eovered in a workbiok on 
nndtiple-faetor unnly.si.s. 

The. Vretom of Miiui has been out of print twice, and the eurrimt reprint¬ 
ing i.s now exhau-sted. When the writing of the present volume wa.s started, 
it was my intention to revi.se The Vretms of Mind, re-writing certain Ht‘c- 
tions and making additions of new material. This plan was altered by 
adopting a more complete exisisilory style for the present text. The entire 
IsHik has betMi re-written, and hence it has Insm given a new title. The TVr- 
loro of Mind will be referred to in this te.xt as the "first edition." 

If ha.s not been my intention to produce a bibliograpbically complete 
treatise on multiple-factor analy.sis. That would be entirely beyond the 
scope of the jire.sisit text, (Jnly tho.se refercneeH have la-en given that were 
directly in line with the subject of <liscus.si«»n, but I fear that even with this 
limitation I have not done jimllee t« all the aufhor.s whose, work .should 
have las*!! summarized in this text. Most of the-se ref(*rencc.s nre readily 
availahle in the journal /’si/cAonic/iiknand in the bibliographies of its many 
paiH'.rs on factorial theory. The subject is still advancing rapidly, so that a 
theoretically compicti' treatise, wouhl Is'i'orne obsolete in a few years. When 
the time comes for.snclt a volume, it .should be written by a mathematician 
or by an author who is competent to upprai.se the contributions of matlie- 
nmticiitn.s and physicists in this field. 

Tlie brevity of The Vectors of Mind was ])robably rcsjHin.sible for mneh 
of the controversy alsmt multiple-factor unaly.si.s. As far as I aip aware, all 
the theorems in the first edition are as valid today a.s they were teh years 
ago. Tlie theorems were .stated, and, in general, they were proved; but I 
left them without the snp]«*rt of existsition as to their iinplieutiom* amt in¬ 
terpretation in exploratory scientific work. Several coni-ppls have Ijeen the 
subject of conf mversy. It lias been a mystery to tins why the fundamentally 
simple notion which 1 called "simple structure" ha.s Isstn twisted around 
by some critics into tlie most inconceivable nonsense-. Then* baa Isnm 
miHundersianding alstiU the cummnnality concept by whicli multiple- 
factor analysis Is limited to the comitum factors just as it is in Spearman 'k 
aingle-fae,tor case. Some students of this aubjcct change their set in going to 
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t«,,p»,e.Th»reha.atob^ »nto™^^^^^ 

which represents parameters or - minuliitidii 

population as well as in 

men multiple-factor analgia 

shift of emphasis. Papers *h. 

cemed with the existence o .. p , pnilialth- r>rntr rMriHHh*" 

tetrad difference criterion for the rf^ard.*.! a.-* th^ d,. 

for the tetrad difference, and group Znx^ a. 

turbers of the general factor -"‘I„.w 

^r"rdjx%“:; p 

dicated by the correlations without restnc-tioii iw to whi‘llu-r In > nr* a 
eral or group factora. Instead of extriwdinR. fimt, the {>..!* til eiK-*! 
factor and then investigating the residuals to determuu; wh-tlinr ao> j i- 
turhing group factora must also bo adintltwl, wi* start wit». ail o»*.nrv»?i 
equation in n terms which represent as many faHor. «. may 1- r-.u.r.S 
by the correlations. It becomes, then, a tpiesf i»n ..f fa-i a- «*' who Imr mi., 
or more of them are general factors and whether one or more of them m-- 

^°Ourm°atrix formulation of the problem Iwl hi the fuml.amenlftl fa* (**» 
theorem FF' = B, where F is a factor matrix anti k is I lie eorndation ma 
trix. The matrix formulation of factor analysis swans to have be<*» geii«-it.Hy 
accepted, and it has largely replaced the previmm mrthoils m fm-tor 

analysis. , • , # . 

In 1931 I decided to investigate the relation lielwwn inuHiJilo-in* tor 

analysis and Spearman’s tetrad differences. When I wrote the tetrad wpm- 
tion to begin this inquiry, I discovered that the tetrad was merely th*' ex 
pansion of a second-order minor, and the relation was then ohvioiw. Hoe 
might speculate as to whether multiple-factor anidysis wouM have ih-. 
veloped earlier if this interpretation had bwm statwl earlier. If the 
order minors must vanish in order to estnhlisliwl a .siuRle common fa* toi, 
then must the third-order minors vanish in oriler to estahlisli two eommoii 
factors, and so on? To have put the matter in this way would have h-»i in 
the matrix formulation of the problem inueh earlier, as w'ell as lo th** im¬ 
mediate development of multiple-foittor analysis. Instead of dealiiiK w ilh 
the proportional columns and rows of a hieran'hy titul the vanishing tet ¬ 
rads, we now deal with the same relations in tenna of the projierties of unit 
rank, namely, proportional columns and rows and vanishing sw;ond*order 
*L. L. Thuratone, "Multiple Factor Analysis," Pnyrhalogiral XXXVHI 

(September, 1031), 406-27. 
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iiiiiitii'.*!. TliiK fmumlation gfiifrnlizos to th« pinpnrtitNS of liijilu'r nink. As 
far ius I am awaro, this foniiulafioti of fho factor problem has been neiierally 
accepted, 

'fhe test cuiTcIaf ions define a cemfigiiration of test vectors without a ref¬ 
erence frame. Kinct,* the factors are represented by the. axtjs of this frame, if 
is necessary to loeatd*. a reference frame somehow in the test configuration. 
Here we have to recognize a dhstinetion between an arbitrary orthogonal 
refereiiee frame, that is vised for eomimfiiig puristses and the referenee 
frame that .slionld he used for .seienfitie interpretation of tin? faelois, The 
ai'hitrary orthogonal frame i.s delinevl b 3 ' the mt^lliod of fachtring that (he 
eompnter Inippeiis to n.se. Iti order to loeatv? a referenee fraim? for interpre- 
(atirin, I nsv'd, at first, a.stafistieal eriterinn whieh led to tin? prineipvd ax(‘.s 
of tlie ennfignration; hnl 1 .siu>n diseanh'd this solution in favor of a prin- 
eiple, that I called "simph! strueturv!.” 'I'his prineiple of .simple .structnre 
has been thvi eause of mvieh varntroverny, aval if is not yet vu'cepted hj* all 
stvnieiits of factorial theorj'. Tlie fact that it veiy friainently give.s a .set of 
factors or parametvfrs tliat can in) interpreted as meaningful in seienlifie 
eontexi woulil seem to be an argument, in its favor, imt even that restill 
has been the object of eoufrover.sy. I have founil lluif tlvu best way to eon- 
vinee a skeptic is (o let liiiii work with tint rolatumal melliods on a jvroh- 
lem ill whieli In' is interested. As (he referenee frtime liegin.s to emerge hi 
the rotational work willi .sin’eessivel.Y clearer interpretation. In* eouvinees 
himself of the power of tin* methoil. 

Ill locating a meaningful rvrfereniat frame f<u‘ aset of correlated variables, 
one may voluntarily im|Kwo the restriction that the referenee frame shall 
h»> orlhogonul, or one may allow it to beconie tdiliipiv! according to 1ht‘ leal 
eontigiiration. If we imiKi.se tin? restriction that the rttfereuee frame .-hall 
he ortiiogonal, then we are im}H)sing tin* condition that flat faetor.s or 
paraiiiefers .sliall be uneorrehited in tin* expt»niiientul impvilution or in the 
general impnlation. It is my own eouvielion that tln.s restriction .sltoiihl 
not lie im|Hi.sed if wv* are looking for nu'aningfnl parunieters. It .seem.s just 
as unneee.'>m- 3 ' to rerpiin! that mental traits shall he nneorrelated in the 
general {Htpiilatmn a.s to nsinire that height ami weight he nneorrelnttsl in 
tin* general jHipulation. 'I’liis aiiini.-.sion of ohlitim* axi's has also been vie* 
haled ami is not jntt gein;rally aeeepteil hj* .stinh'iits of factor tlnsiry. 

The eorrelaiions uinoug primary faefttr.s mn.st 1«* exiH'cted to vary from 
one experimental |s)pnlati«m 1vi another, depending on seleetiveeonditions, 
Tliis dot-s not mean that the itliy.-ical nature, of each factor or paramntv'r 
lias alfei'etl. .lust a-s the eont*la(ioii l«*tween ln*ight ami weight vurie.s from 
out,? group to auotlier l»j* .s(*li*etive eom{itioii.s, sti tint correlations istlWH'ti 
mental Iruils may also vaiy from one group to anothttr without ehaitge in 
tintir nieaniiig. 

Hecond-tirder faetors whicli are determined from thceorrelated primaries 
have only recentli*^ been introduced, tsvj that it is not yet known how fruitful 
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they will be. It seems '. 

from correlated pnmaries, y in •‘-“ Sj 

tive factor g. Spearman ea y of oiir prwn« nh>.>y v;*^ c !; 

must not be very similar ™ ^ ^ involve only »•««■ prinoir.v fjv - 

that aset of four testa can - • j .-id. r 

tor for each test. Such a set «f J;" „f nnit r.o.k. .ud 

general factor m common, cnu^ vanish. When two ?*in»iinr »*■;*•* >* nir in- 

the second-order minor.s ™ ‘ involve the anine priumry n- w lS -» * 

eluded in a tetrad, they arc ‘^elV to i, aiMnrl. 4 

the second-order general &c r, re'iiiilttt it n* to dif ■ 

In the scientific interpretation of f i„varh.n« r” 

ferentiate between what f ‘ .,,,,rj,linn ro..Jl.. 1 . ^ In 

the numerical invariance 

general, configum^mna^iw^^^ ,.xpi‘riiiu-nlH! ftiihj.** i.* 'Ho-'’ 

SU™r.ted in .n.l,M»l f..», ta. W 1. lik-b' »'»' 

ideas will precede the analytical forms. 

Since the publication of The lVr/«r.s of .Uiiof, Ihnr Is-n 
texts on factorial theory. The text by Holxingcr amt Hnroiian h. • 

tor analysis as a statistical method.* Thm m a wortl.-wloh- r.hj.- 'n--, t* 
the mathematical stati-sticians have not, yet accii»t<Hl fiwtor ao.>»l>-ij - 
part of statistical logic. Holsinger describca Kcveral fiiHormn taHhoib, in 

cludinghi8 0 wnbi-factormcthod.Thc 8 unple-.str.icl«r»M-onrnM..h>.[^^ 

of in a footnote, but the rotational problem w pre-wiiteit in varom* f«-nn« 
of factorial resolution. It is unfortunate that the lerm ‘St rartore lo.. U-n 
defined in different ways. Holzinger ac*cepl8 the mail is foramhitmo »b'< 
multiple-factor problem and the interpretation of Spt‘i.nimn V MiiKh-fm^S-r 
hypothesis as a special case of unit rank. 'Hie oblique nsM nre 

as alternative solutions. ,.,11 

Truman L, Kelley’s monogiaph, limnlitU Traitx rf /.»/<■ J 

soribes an ingenious method of arriving ttt the priiieiinil-ase^i iadiHi<o» *li- 
rectly from the correlation matrix. Kelley iloe« not w-cepi the romnniioih- 
ties, or the simple-structure concept, or rotation fnmi the prim ipal a-o >- 
for the purpose of isolating simpler and more iiiettniiiRfol parntoeiery Ue 
attempts to interpret directly the principal ftxw of eimh Uwl hiitiery Keltcv 
insists that factor analysis must be made with unit diiiRMiml-' to rfqtt«s«*-oi 
the total variance rather than the conimou-faflor vurimui*. Hi** »*!oh*'i 


♦Karl J. Holzinger and Harry H. Harman, Factor Aiuilm* l’)«vr!»uv t.i 

Chicago Preaa, 1941). 

t Cambridge: Harvard University Press, 1935. 



nion(ignij)li, Crnnsrondx in the Mind of ^ fan,* kIiouIcI tilsri be acknowliidged 
jiH a siKiuticanI ('(iidiibiifimi. In that, publicatirni hn attempted to break 
away fnini the dominant singh; general faetfir to the niultiple-fartor prob- 
h'lii, bnt ho did not then iTitroduee the generalized factor problem. 

Burtf accepts the (snninunality noncept, the matrix forninlatioii of fac¬ 
tor analy.sis, and th(^ interiirctation nf Spearman’.s singlo-faidor hyixitheais 
as a special ea‘io of unit ratik, but he »loc.s not accept the necessity for ro- 
fating the referents* frame for pm’iK».se.s of interpret at ion. Xeithrr tloas he. 
acceitt fht* n.se, of oblii|iie reference axes. ^I'he coniigurational interprota* 
timi-s arc evidently tlistiiKteful hi liurti for he dttes not liave a-single dia¬ 
gram in hirt text. Perhaps this Ls indicative nf individual difTereiices in 
imagi*ry tyjies whiidi lead to ditTerenetw in methods and interpretation 
aniotig .scientists. 

Tl'e mo.s|. provocative of the recent texts in factor fhwiry is that of Clod- 
frey H. Thomson.} Mvc'ii when he dilTer.s from our interpretations of the 
factor iiroblem I find his di.scussinn Htimulating for our own work. Our 
chapter on .selective conditions and .seetinns of the ehafttcr on \unt rank 
n*sullcd tlirectly from the stimulus of his pnivocative jiapers. lie lines not 
.seem to be convinci-d about the necessity for rotating the. rcferenei* frame, 
allliougli lie is probably open-minded almut the ipie-stion. He i.s not opti- 
nii.sfic alHoU the interpretation of primary factors as ftindameulal parame¬ 
ters in file «leseri|ifion of mentality. 

While there has Ix-eu eonshleralile eontroversy alsmt multiple-Jaelor 
analysis, it is iirobably true that the large majority of factorial studiea in 
recent years have acei»p(ed the. matrix formulation of the, problem, the 
interpri'tation of Spearman's single-factor thisuems as a sixteial case of 
unit rank, the communalitics, the. .simplc-Klrueturc coneept, the nm^issity 
for rotating the refereitee frame for Hcieiitilic interpretation, the desira¬ 
bility of interpreting the primary factors us meaningful parameters, lire 
use of oblique referenee ase.s, and the prlneiples of configurational in- 
vai'ianei*. 

No attempt ha.s been mmle liere to review the numerous applications of 
fiu-tor atial.v.sis to psycliologicul and other problems. Duel Wo]flc'.s mono- 
gruiih. I'nrtor Analtfuin to was a gooil somtiiary of theory and of 

appliealimis, and sueh reviews should ho made pcriodieally either by new 
monographs like Wolllo’s or Ijy periodic summarie.s in the I'sycholtigicnl 
iinlletin. h'or .several rea.soiis in tho present fe.xl 1 have ustHl very few imy- 
ehological le.Ht examples. WheJ4 |»syeliologisfs start to work with iwyeho- 

♦Si:iiifnrt|, Slnarord I’liivcntiiy IVciw, 1U2S. 

t t’j-ril ttml, 7V«c Ftiflom of Ibe Mind (New V«irk: Muciiiillaii Co., ItHl). 

f The FwioHat Analynn »>/ Ifuumn AbilUij (Sew York: IIoiikIiIoii Mifliin €«,, IttStf). 

{'THyclitJiiietric .MiitcgrtipliB," So. 3 (Chw-ugo: Uiiivereily of aiicHgo Preaw, Ittttt), 
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W f\r^A mimary mental abilities, they soinelimcs 
logical test correlations to fi „ discussion about fa(!tilty psyrln^lMgy. 'rhe 
jump the track and ^ more clearly by using physical 

logic of the subject can be P ^ „f rectangular boxes, 

objects. That is Here the stmlent’.s 

populationsof cylinders, a d parameters in the 

attention is directed to P rehUioii.s of the 

mentbefore the sampling-error fcirmiiiae. It 
actonal 102“ “ bifluenL of selection of tests and of (‘XF.eniiientiil 
IS only recently that inhue . ^^d. Tliose effects must, lie 

produce stahie mmmncal vaWs 
and those in which configurational invariance is of primary inteitsl- li e 
relations of second-order factors to factorial results have also only recent > 
beeSvestigated. At present we are limited largely to the empirically ob- 
aerveHtability of factorial findings. The availability 
formulae for the principal-axes solution for a given correlation main. - 
good L far as it goes, but this is a trifle compared wiib the. samiibng- 

error problems in factor analysis. , 1 !• 

Pactor analysis hss not been generally accepted by mathematical statis¬ 
ticians. The present conceptual formulations of statistical theory d'* i»;'t 
seem to lend themselves readily to the logical problems of factor analysis. 
One might resolve this difficulty in one of two ways. One imglit insist that 
multiple-factor analysis be re-written within the restricl.ion.s of current 
statistical theory, or one might ask the statisticians to adaiit ami expand 
their formulations to cover the logical problems of factor aiialy.sis. Perhaps 


both ways will be tried. 

When the mathematical statisticians eventually decide to assist tlie. si u- 
dents of multiple-factor analysis, it will be helpful if certain fumlamenlal 
considerations are recognized at the outset. Some of thc.se can lie li-sliul 
here. First, let us recognize that when a scientist is trying to invent a tiicoi y 
to cover the phenomena of a particular domain, a simple description of its 
underlying order, he is certainly not concerned with sampling distributions, 
Furthermore, he must restrict himself to some aspect of the plienoniena in 
the domain. He cannot hope to cover the total variation, for no Hcienlilii! 
formulation ever covers the total variance in any domain. Wlicii tlic .slal is- 
tician turns his attention to the multiple-factor problem, lie must, deal 
with the communality concept and its effect on the rank of the correlat ion 
matrix. If he denies this problem, he not only admits his inadequacy Imt, 
also his failure to understand the problem. If statistical theory is not now 
adequate to cope with the communalities, then the stati.stician has the 
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challenge to adapt his formulations to the limitations that are inherent in a 
very large class of scientific problems. He need not deal with the commu- 
nalities as such because he may discover some equivalent resolution, but he 
will not solve the problem by laughing it out of court. 

Another consideration with which the statistician is already familiar is 
the distortion introduced by the assumption of linearity in the exploratory 
study of a new chjmain. Treatises in the more advanced sciences abound 
with non-lincar relations. Linear relations arc the exception. There is no 
good reii.sou to believe that relations in the younger sciences are funda¬ 
mentally simpler. When scientific inquiry enters upon a new domain with 
hazy ideas about the underlying order or, perhaps, with no ideas at all, the 
.scientist is as naive as we would be if we should make an experimental in¬ 
quiry about the relation between the sizes and the weights of boxes with¬ 
out knowing their contents. He would measure and weigh the first one bun¬ 
dled boxes and determine the correlations and the regression equations, 
and then he might worry about the standard errors of his coefficients. 
Something would be gained by doing that, because it would affect the de¬ 
gree of assurance with which he could say something about the relations 
that he had found. If the scientist takes his numerical coefficients very 
seriously at the exploratory stage, ho may be lacking in a desirable sense of 
humor about the crudeness of all his tools in spite of their polished appear¬ 
ance. Too much concern with numerical minutiae at that stage may lead 
him astray from the conceptual formulations that constitute his real goal. 
If factor analysis is one of liis tools for the exploration of a new domain, his 
principal concern will be with the factor pattern, the presence or absence 
of a significant coefficient in each cell of the oblique factor matrix, rather 
than tlic numerical values of any of them. This consideration may simplify 
the statistiedan’s problem in factor analysis. 

iSo far, one of the principal handicaps of the statistician in dealing with 
multiple-factor analysis has been his failure to appreciate the significance 
of the rotational problem. This is the pi'oblem of choosing the most fruitful 
set of pai-ameters to describe the variation in a domain. Those parameters 
represent .scientific concepts. They are not merely numerical coefficients. 
If those scientifically meaningful parameters happen to be correlated in 
the experimental sample, such as height and weight, that is no reason for 
rejecting tlicrn. The prior consideration is to find fruitful and meaningful 
parameters. The question of whether the cross products vanish is a trivial 
consideration of the coinputcr'.s convenience. The statistician must under¬ 
stand this problem of oblifiue reference axes and associated scientific con¬ 
cepts. The statistician must not impose the arbitrary rastidction that our 
scientific concepts in the description of people must be uncorrelated either 
in the experimental sample or in the general population. 

In attempting to introduce sampling distributions in factor analysis, it 
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Bdnate. These to different degrees of over- 

ment, and no statistical I'JSK J7 obscures them, 

determination unless 1 foLiulations in statmtieid theory is 

One of the most from which the sample is drawn. A 

that of the sample Tliis often leads t«. 

large part of statistical ^ ,g jg representative of a postulated 

. Icem ae to rrl^ “1?: that the eaperinrcntal 

aniverse. One might enp]^ general population, but such is not the 

p,e dionld be * „f Lta is to be investigated ea lo 

.see. On the ^ pjeed se in many other types of srionlihe 

their underlying structure, we p sample, including oven freaks in 

investigation by selecting faetorially studied 

the domain concerned. ^ „„Unssd sample tarn the 

any ^ *fmnl inTre lihely to be rsvealing of the 

game universe. Such stuams carefully randomized samples 

underlying nature of t e fu-ther there is no necessity that the fre- 

fromthe general populatio . i Qaugsian Let us also not forget a 

Tpr measure something significant without any sampling distribu- 
j:;:l'‘£"=o-thing'trilial or irmlevant bseanse it. sampling 

distribution is fact that students of factor anal- 

In a recent paper Hot to g pl advances in mathematical statistics, 

"ISr^tetato nW concepts of mnllipWactor amdysts be- 
and he disimsses me lun .. f statistical theory. 

ci^tohaveno t^^»™^““^Xbly aeknowledgo that vre 

fJ^dS^c^edbetter in gelling the eo-opo«tionot,host^ 

if recent advances in statistical theory had been recognized ' 

t would probably also acknowledge that, while statistical theory LsoS made 

important advances in the last twp decades, it has not J 

toL immediately useful for factor analysis as a scientific method without 
Lill further advancement. Instead of dismissing the basic 
multiple-factor analysis, we must reach common ground in recogmzi g 
that these concepts r^esent difficult problems in the logic of science that 
need to be studied rather than ridiculed. Let us hope that 
dents will begin soon to investigate thase challenging pmblems, so that the 
factorial methods can be made generally available in the sciences withou 
the handicap of distracting controversy. 
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A special acknowledgment is due Mr. Ledyard Tucker, who was my 
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and computational methods of multiple-factor analysis has been of the 
greatest aid not only in preparing the present manuscript but also in the 
numerous factorial experiments that have been made here in recent years. 
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years in the development of factorial methods and computation, and she 
assisted in preparing this manuscript for publication. A large part of the 
computations for this text was done by Mr. Frank Medland. Miss Lorraine 
Bouthilet also assisted in editing the manuscript. The preparation of the 
manuscript was done by Miss Florence W. Brown, Miss Geri Blocker, 
and Miss Alexandra Thanos. The Index, which was prepared by Mrs. 
Dorothy C. Bechtoldt, was made quite extensive so as to be us^ul to the 
student reader. I have sincere appreciation for the loyalty and interest of 
these student assistants. My principal acknowledgment is to my wife, who 
has been a partner in the formulation of each problem, as well as in all the 
experimental studies of this laboratory. 

The Social Science Research Committee of the University of Chicago 
has been generous in providing space and research funds for the Psycho¬ 
metric Laboratory, Our work has been greatly facilitated by several re¬ 
search grants from the Carnegie Corporation in New York for studies of 
primary mental abilities at different age levels. To the University of Chi¬ 
cago Press we want to express our appreciation for its interest and techni¬ 
cal assistance in several publications of the Laboratory and, in particular, 
to Miss Mary Alexander of the publication department. 

A NOTH ON FUTURB WORK 

In presenting this text as a summary of our work on multiple-factor 
analysis, it may be appropriate to mention some possibilities for the future 
development of this subject. One of the principal assumptions underlying 
factorial theory is that the scores are monotonic increasing or decreasing 
functions of the scores oh the primary factors or parameters. The funda¬ 
mental observation equation of factor analysis makes the further assump¬ 
tion that these functions can be expressed in linear form as a first approxi¬ 
mation. It would be possible to start with a second-degree observation 
equation and to develop factorial methods on that basis. Instead of devel¬ 
oping factorial theory more completely with observation equations of 
higher degree, it would probably be more profitable to develop non-metric 
methods of factor analysis. An idea for such a development would be to 
determine the number of independent parameters of a score matrix by 
analyzing successive differences in rank order on the assumption that they 
are monotonic functions of a limited number of independent parameters. A 
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MATHEMATICAL INTRODUCTION 

The matrix theory which is used in the development of factor analysis is 
not generally available to students whose training in mathematics is limited 
to undergraduate courses in analytical geometry and in the calculus. This 
mathematical introduction reviews the elementary theory of matrices as 
well as the closely related theory of determinants. Summation that involves 
double subscript notation is included in this section, since it is used in factor 
theory and since it is unfamiliar to most students of statistics. In the geo¬ 
metrical interpretation of the factorial matrix, only non-homogeneous co¬ 
ordinates are used. For this reason, the introduction includes non-homo- 
geneous co-ordinates and omits homogeneous co-ordinates which are con¬ 
ventional. Orthogonal and oblique transformations have been illustrated 
geometrically. No provocation has been found so far in factor theory to in¬ 
troduce imaginaries and complex numbers, but the future development of 
factor analysis may call for them. This mathematical introduction is limited 
to the real case, and all theorems have been written with this restriction in 
mind. 

If this introduction is not self-sufficient, perhaps it may serve as a useful 
guide to the student of factor theory who seeks mathematical assistance on 
specified topics. If a student has the intention of attaining some competence 
in factor theory and in related statistical work, there is no short cut for 
formal courses in the mathematics that is involved.* 

Matrices 

Matrices and determinants involve rectangular arrangements of num¬ 
bers. Any rectangular arrangement of numbers is called a matrix, irrespec¬ 
tive of what the numbers mean. If the matrix has m rows and n columns, 
the matrix is said to be of order mXn, In designating the order of a matrix, 

* The following references will be found useful: 

W. F. Osgood and W. C. Graustein, Plane and Solid Analytic Geometry (New York: 
Macmillan Co., 1020). 

L. E. Dickson, Afodern Algebraic Theories (New York: B. H. Sanborn, 1026), chap. iii. 

Maxlmc B6chcr, Inlroduclion to Higher Algebra (New York: Macmillan Co., 1031), 
chaps, i-vi, inc. 

H. W. Turnbull and A. C. Aitkcn, Canonical Matrices (London: Blackic & Sons, 
1032), cliap. i. 

V. Snyder and C. II. Sisam, Analytical Geometry o/ Space (New York: Henry Holt & 
Co., 1014). 

A. Adrian Albert, Introduction to Algebraic Theories (Chicago: University of Clilcago 
Press, 1041). 

W. L. Forrar, Algebra (Oxford University Press, 1041). 

Arnold Dresden, Solid Analytical Geometry and Determinants (New York: John Wiley 
& Sons, 1030). 
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MULTIPLE-FACTOR ANALYSIS 


it is customary to refer to rows first and columns second. Thus a uiat rix of 
orderTxThS P ™ws and 5 columns. Tables la and lb .sh.nv a matrix uf 
otL 3X4 and a matrix of order 3X3. A row is honraintal. A column .. 
verticd The general name for either a row or a column is an «i ni.v- I .a.’h 
Ime small squares into which a matrix is divided is called a cell, and Iho 
number in each cell is called a cell erdry or clcmeni. 


Table la 

Table lb 

2 3 1 B 

2 1 r, 

16 0 9 

4 8 3 

0 2 6 7 

2 0 7 


In order to designate a particular element, it is customary to use a doiilde 
subscript, the first one for the row and the second one for tlie column. If a 
matrix is denoted A, then its elements may be denoted o.-,-, whi'n* i show.-, 
the row and j shows the column at the intersection of which the elemenf «„ 
is found. Thus, in Table la the element aii=3 and 054 = 9. 

In developing the theory of matrices it is desirable to exhibit thn ele¬ 
ments as shown in Table £. The elements in the first row are «ii, «is, «m, 
, ., au, showing that the table repre-sents n matrix of n columns. The ele¬ 
ments of the first column are an, an, Uai, • • . i showing that I he table 
represents m rows. The general element in this matiTix A is d,,’, wlu-ie i 
takes the successive values 1, 2, 3,... , m, while J takes the suiu-essive 
values 1,2, 3,. . ., n. The first subscript refers to the row; the second sub- 
script refers to the column. 




ratfc s 


Oil 

OIJ 

On . - ■ 

«ln 

On 

0:1 

Oj3 . • • 

Wjn 

agi 


*JJ ... 




, ... an 



Cma 

Ojni • - ■ 

fluifi 


The conventional representation of a matrix is shown in H'ablr J, where 
the rectangular arrangement of numbers is inclosed by double veiiicid lines 
on the left and on the right sides of the rectangle. It is also customary to 
denote specified matrices with letters. Thus, tlie matrix of J'nblo H uuglil be 
conveniently designated A or any other letter. A msitrix A might, also be 
designated by its general element oj;. 


Tables 
2 16 

4 8 3 
2 0 7 
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If the successive rows of matrix A are written as successive columns of a 
new matrix, the new matrix is called the transpose of A. It is denoted A'. 
Table 4 shows a matrix A and its transpose A'. 


1 2 3 1 T) 

Table 4 

2 10 

10 0 0 


3 6 2 

11 0 2 0 7 


1 0 0 

A 


S 0 7 

A' 


Determinants 

One particular interpretation of a square matrix is called a determinant. 
This interpretation of a square matrix probably had its origin in the practi¬ 
cal work of solving simultaneous equations, and it is indicated by single 
vertical lines on the left and on the right sides of a square table. It is illus¬ 
trated in Table S. Table 3 is called a matrix; while Table B, which implies a 
particular interpretation, is called a dctermina7it. A determinant is always 
sqiuirc. Hence its order is ?i, in which n is the number of rows or the number 
of coluinnH. 

Table S 
2 1 n 
4 8 3 
2 0 7 

The diagonal from the upper left corner to the lower right corner of a 
determinant is called the principal diagonal. In I'able B the principal diag¬ 
onal contains the elements 2, 8, 7. The other diagonal from the lower left 
corner to the upper right comer is called the secondary diagonal. 

In many problems it is convenient to assign a plus sign and a minus sign 
to alternate cells in a determinant. A convenient rule is to designate the 
upper left coll as positive and all other cells as alternately negative and 
positive, as the cells can be moved over by the castle in a chess game. This 
sign arrangement is illustrated in Table 0 for a determinant of order 5. 


Table G 


+ 

— “ 
— + — 

+ — + — + 



4 multiple-factor analysis* 

Notice that the cells in the principal diagonal are all and Jhai iin..,, 

paiallel to this diagonal are alternately negtHive and 1 hr Am i- 

positive for an even number of steps from the rrll and i‘ i- n.-«,> 

tive when the number of steps is odd. The sign r.f a erll d. Sonnim d sn »lu» 
manner may be called the position sign of Ihc rdi If the g.-n.-nd » !> inrnf ,4 
the determinant is denoted a,,-, then the elemenl with its jn^iti..!i mki, ii,ny 
be conveniently denoted (-!)'+'««. When the expruient u ts ».dd, tie- 

sign of the cell is negative; and when (i+j) is oven, the .M«n .-f ... i). 

positive. 

The product of any n elements of a square matrix, .‘.i-lf't t^-d wiMi ».»!> mui- 
element from each of the n rows and only one element from eueh of the « 
columns, is called a term of the determinant of the mulrix. T>th!> : i« ;* dcSer- 


Tablc7 
Oil Oi* flu 
fl]i flu flu 
flu fln flu 


minantof order 3. From this determinant six leriiis may In- written, "niesie 
are shown in Table 8, in which the elemcnt-s of eai’h fi‘rm an* arranged in 
the order of their columns. 

'/ViWii.V 

1) flu OJS flu 

2) a„ «„ fl« 

3) flji «ij flu 

4) Oji an flu 

3) fln fln flu 

0) On flji flu 

Each of these six terms is the product of three elements so selerted that 
each term contains only one element from each row and mdy one eh-mt-iil 
from each column. If a square matrix is of order ri, the tiital itumlsT i»f 
terms in its determinant is n. The term that containa all the elemt-nfs nf 
the principal diagonal is called the leading term of the dctterinimtnl. 

The sign of each of the n terms of a determinant can Ih* aseertHiiK'il in 
the following manner. Let the n elements of each tenn be arratiKi-il in as¬ 
cending order according to columns, as shown in Table 8, Tliia t-nii cvidt-ni- 
Ik t affecting the numerical value of the terms. <‘nnsidiT 

the fourth term as an example, and list the rows os follows; 


2 3 1. 
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Any interchange of two adjacent elements constitutes an inversion. It may 
be illustrated by interchanging 1 and 3. The resulting arrangement is 

2 13 . 

If, now, the adjacent elements 1 and 2 are interchanged, the arrangement 
becomes 

1 2 3, 

in which the rows are in consecutive order. 

The sign of a term of a detenninant is positive if it represents an even 
number of inversions from the consecutive order of rows and columns. The 
sign of the term is negative if the number of inversions in the term is odd. 

Applying this rule to the six terms of TahU 8, we have the same terms 
with proper signs as shown in Table 9. 



Table 9 


1) 

+ttii 

On 

On 

■i) 

—On 

a» 

Ojj 

3) 

—an 

Ol» 

0)i 

4) 

+Osi 

a» 

On 

a) 

+on 

Oij 

Oil 

0) 

—On 

On 

On 


A complete definition of a determinant can now be given. 

Definition: If a square table is used as a symbol of the sum of n terms, 
each term being the product of n elements with only one element from 
each row and only one element from each column, the sign of each term 
taken positive or negative according as the term contains an even or an 
odd number of inversions, then the square table is called a determinant. 
Hence the sum of the six terms of Table 9 is implied by the determinant of 
Table 7. The detenninantal interpretation of a square matrix is denoted by 
single vertical lines on the left and on the right sides of the square table, os 
shown in Table 7, 

If a sqtiarc mntnx is denoted by a letter such os A, then the determinant 
of the matrix is denoted |A|. If A represents a number, then |A| means 
the absolute value, ignoring the sign of the number A. It should be noted 
that a matrix is merely a rectangular table of numbers, and hence a matrix 
has no numerical value. But a determinant is, by definition, a sum of terms, 
and hence it has a numerical value. If a matrix is denoted a,/, then its de¬ 
terminant is denoted |ai/|. 



Q MULTIPLE-FACTOR ANALYSIS 

Consider the second-order determinant 

1 5 
8 3 

and the 2=2 terms that it implies. These arc 1X3 and SXa, in winch iht; 
factors of each term are arranged in consecutive order hy cnlinnn., I he rows 
of the term 1X3 are 1 and 2. Since these arc in conwcuHvc order, the 
of this term is positive. Its value is therefore -1-(1)(3) - 4 3. I he rf.\v.*« of 
the term 8X5 are 2 and 1. One inversion ehanges the order 2 and 1 rni «> ihe 
consecutive order 1 and 2. Hence the sign of this term is neRative. 'l‘he <h- 
terminant therefore has the numerical value 4-3-40= -37. Any .•iceond- 
order determinant can be evaluated as follows: 

a d 

= ab — cd. 

c h 

An rr-rowed minor of the matrix A is a detcrtninmil of onlt'r x which is 
formed by the intersections of any x rows and any x columns of the tii!i- 
trix A. If one or more columns of a determinant arc clitninalcd luul if the 
same number of rows are eliminated, the remaining ctdls CfUistituic a mnwr. 
From the detenninant of Table 7 nine second-order minors may 1«? ilrawii. 
A few of them are illustrated here: 

Qii ait Uti Ui9 (ii] 

I ■ • 

Oil Ott aji Qgj (Itt U], 

If any two columns and any two rows are eliminated from the deternunaiit 
of Tabu 7, there remains a 1-rowed minor which is a single clement. In this 
sense each element can be regarded as a minor of the determinant. 

If corresponding rows and columns are eliminated, the nunaining luiimr 
is symmetrically placed with regard to the principal diagonal, and it i.s 
called a principal minor. In the determinant of Table 7, three Beeoml-ijrder 
principal minors may be drawn. These are 

Oil Ois Oil Oi» ojj an 

I » • 

Oil On 031 033 Oai a»i 

There are three 1-rowed principal minors in this determinant, namely, th(j 
three elements in the principal diagonal. 
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If the row i and the column j which intersect in an element Oi,- are elimi¬ 
nated from a determinant, the remaining (n—l)-rowed determinant is 
called the first minor of a,;. This definition is illustrated with the determi¬ 
nant of Tahh 5. The second row and the first column intersect in the ele¬ 
ment 4. If these two arrays arc eliminated from the determinant, the re¬ 
maining 2 -rowod determinant is 

1 5 

= 7 - 0 = -h 7 . 

0 7 

This determinant, whose numerical value is -|-7, is the first minor of the 
clement Oai = 4 in the determinant of Table 5. Let the first minor of the ele¬ 
ment a,y be denoted 711 ^. 

In some problems it is convenient to refer to the minor my,- with the posi¬ 
tion sign of the element ay,-. This quantity is called the cofactor of ay,-. It is 
defined by the relation 

(cofnetor of an) s cy,- s ( —l)*+>my,-. 

In Table 5 the cofactor of the clement 4 is 

1 5 

= _ [7_()] = _ 7 . 

0 7 


In the same table the cofactor of the element 3 is 

2 1 

(-1)1+3 = - [0-2] = -f 2 . 

2 0 

Hence the absolute values of the first minor of oy,- and of its cofactor are 
identical. They differ only in the manner of determining the sign. If the 
position sign of the element ay,- is positive, the first minor and the cofactor 
have the same sign. If the position sign of a,-,- is negative, they have op¬ 
posite signs. 

The numerical value of a determinant can be expressed conveniently for 
some problems in tenns of the cofactors. P'or example, 

an an au 

ttai flas Ojj = aiiC)) -H 021621 "h Oaifiai . 

031 a32 033 
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The mmerical «*» nl a iamrdmM U Ihe mighud .im 0/ the elrmnite m 
arrag, mh demrU bdvg wdghUd bg if eefacter In Ihn Mnmpin. Il« 

deLnlmiit fa Mptfawi i» to™ »' «“ 'Tt . 

As a numerioal example, the value of the determinant of Trthlr S oan !«; 

expressed as follows: 


2 1 
4 8 
2 0 


= +2 


8 3 
0 7 


-4 


1 6 
0 7 


- 1-2 


! 1 n 
H a 


ft ! 


= 2(S6-0) - 4(7-0) 4- 2(3-40) 

= 112 - 28 - 74 = -I- 10. 

The numerical value of a determinant can be exprcaseil aa tin* anninm- 
tion: 


( 1 ) 


n 

|®i/l “ 


: ^OoCiy, 


where the weighted sum may be taken over any column or any row. T'he 
following is an example of a fourth-order determinant, evnluaf,t*tl hy the 
method of (1): 



24 10 
3 242 
16 14 
10 2 3 


2 4 2 


4 10 


4 1 0 


4 1 0 

|A1 = 

= -|-2 

6 14 

0 2 3 

-3 

6 14 

0 2 3 

+1 

2 4 2 

0 23 

”1 

1 

) 

2 4 2 

0 I 4 


24 2 
6 14 
0 2 3 


= +2 


1 4 
23 




4 2 
1 4 


= 2(3-8) - 6(12-4) + 0(16-21 
= - 10 - 48 -f 0-58 . 


4 10 
6 14 
0 2 3 



1 4 


1 0 


1 0 

= +4 

23 

-6 

23 

+0 

1 4 


= 4(3-8) - 6(3-0) + 0(4-0) 


= - 20 - 18 -1- 0 = - 38. 
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4 10 






4 2 


1 0 


1 0 

2 4 2 

= +4 


-2 


+0 




2 3 


2 3 


4 2 

0 2 3 





= 4(12-4) - 2(3-0) + 0(2-0) 


= 32 — 6‘|”0 = -t*26. 


4 1 0 






4 2 


1 0 


1 0 

2 4 2 

= +4 


-2 


+6 




1 4 


1 4 


4 2 

6 14 

1 




= 4(16-2) - 2(4-0) + 6(2-0) 
= + 56 - 8 + 12 = + 60 . 


Hence 

\A\ = (+2)(-58) - (3)(-38) + (l)(+26) - (l)(+60) = - 36 . 

For every element a,-/ in the square matrix A there is a corresponding 
minor ?»</ and a corresponding cofactor e</. Let M be the square matrix 
with elements m<,-; let E be the square matrix with elements eu; and let F be 
the transpose of E. Then the square matrix F is called the adjoint of A. 
Its elements may be denoted /,/ = e^. 

These definitions are illustrated in the following numerical example: 



2 

1 

5 


56 

-22 

-16 


4 

8 

3 

=A 

- 7 

4 

2 


2 

0 

7 


-37 

14 

12 

56 

22 

— 

16 


56 

-7 

-37 

7 

4 

— 

2 

=M 

-22 

4 

14 

-37 - 

•14 


12 


-16 

2 

12 


F = adjoint of A . 
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A square matrix A is said to be symmetric when A' = A. Tiic-n wo alsc. 
have asi=ais. It is symmetric about the principal diagonal. 

1 4 6 

4 2 8 =fl symmetric matrix . 

5 8 3 

If aij=-aji, so that the signs above the principal diagonal are npi)f>Hil« 
to the signs below the diagonal, then the matrix is said to be skai' symjnNrir. 
A matrix A is skew symmetric if A'= — A. 

0-3 4 

3 0—5 =a skew symmetric matrix . 

-4 5 0 

If all the principal minora of a matrix are greater than or equal to K«fro, 
then the matrix is said to be positive-definite. If, in addition, it is syiiunetric, 
it is a Gramian matrix, 

2 3-3 

2 4 2 =a positive-definite matrix. 

3 6 6 

5 10 13 

10 20 26 = 0 Gramian matrix. 

13 26 36 

In some problems it is important to know the highest order of the non¬ 
vanishing minors. The highest order of the non-vanishing minora is called 
the rank of a matrix. The rank of Table B is equal to its order, namely, 3 , 
because the determinant itself does not vanish. The determinant of Table io 
does vanish, so that its rank must bo less than 3. It contains second-order 
minors that do not vanish, and the rank of the determinant Is therefore 2 . 

Tabu 10 
10 8 1 

8 8 2 =0 
12 1 
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If the determinant of a matrix is zero, the matrix is said to be singular. 
If the determinant does not vanish, the matrix is said to be non-singvlar. 

If I I = 0, then dii is singular. 


If la,-,! 5»^0, then a,-,- is non-singular. 


Most of the theorems in the elementary theory of real determinants are 
(ioncerued with the methods of ascertaining the numerical value of a de¬ 
terminant and with the operations that do, or do not, affect its numerical 
value. Tlie following theorems are useful in dealing with determinants: 


1) The value of a determinant is equal to that of its transpose. 


«1 

as 


Oi 

hi 



ss 



h, 

bs 


Uj 

hi 


«i hi Cl 
Ui 1)2 Ca 
(It h] Cj 



tii 


a» 

es 

hi 

ba 

hi 


Cl 

Ca 

Cj 


2) If any pair of iiarallel arrays of a determinant are interchanged, tiic 
absolute value of tlie determinant remains unaltered but the sign is re¬ 
versed, 



hi 

Cl 


aa 

ha 

Cs 

aa 

ha 

Ca 

= — 

ai 

hi 

Cl 

as 

hs 

Cs 


as 

63 

Cs 


3) If two paralUd arrays of a determinant are proportional, the determi¬ 
nant vaiiiKh(‘.s. 


kti\ 

■= 0 ; 

tti 

aa 

As 

at kiXt 


hi 

ha 

ba 



kbi 

kba 

kbi 


= 0. 
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If then two arrays are identical and the determinant vanishcifi. 

4) If a determinant has an array of ciphers, it is equal to zero, 

a b c 
0 0 0 ! * 0 
d e f 

5) If each element of an array is multiplied by any factor, the value of 
the determinant is multiplied by that factor. 


0,1 

(1% 

Ot 


fli 

Ot 

Of 

hi 

b. 

b, 

= k 

bi 


h, 

icci 

kci 

kct 


Cl 

r* 

r-i 


6 9 8 


1 1 4 


12 18 4 

= 6X9X2 

2 2 2 

= 6X9X2X2 

24 27 2 


4 3 I 



“ reducing a determinant to simpler 
1 1 4 * 

1 1 1 i - (VIS . 

4 3 1 i 

“Ui hi f| 

+aj ~ltt ~r^ 

~ciz 6» n 


tti 

h 

^1 


-Ul 

bi 

Cl 


Oi 

b. 

Ct 

= — 

-Oj 

bi 

Ci 

* + 

a, 

b. 

Cl 


-0* 

bi 

Cl 



7) If an array contains no zero elempn^-n nil . 

mw b. mad. mity by ‘ 

3 4 6 

2 8 8 = 3X4X6 
6 7 9 


= 3X4X4 


1 1 1 


1 1 1 

1 2 5 

*= 3X4 

4 12 8 

2 I- 8 


2 4 « 

1 1 1 


1 1 1 

13 2 

= 3X4 

1 3 2 

2 i § 


8 7 6 


-36. 
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8 ) Every determinant can be expressed as a sum of two determinants. 


(Ol + p) 


Cl 


ai 

bi 

Cl 


P 

bi 

Cl 

(aa+(2) 

h 

Cj 

= 


b. 

Ca 

4- 

i 

b2 

Ci 

(ffls+r) 


Cj 


fla 

&2 

Cj 


T 

&3 

Cs 


9) The value of a determinant remains unaltered if each element in any 
array is augmented by a multiple of the corresponding element in a parallel 
array. 


(a,-|-fc6i) 6i Cl 


fli bt Cl 


bi bi Cl 


tti bi Cl 

(aj + fctg) fcj Cj 

(aj+fcbj) bg Cj 


Oj bi Cj 

fflj bj cj 

+ k 

bt bt Cf 

bg ba Cs 

= 

Qa ba Ca 

Ua ba c$ 


The second determinant in the right member vanishes because two columns 
are identical. 


10) If all the elements of a determinant on one side of the principal diag¬ 
onal are ciphers, the determinant reduces to the leading term. 


6 1 2 

6 3 3 


6 12 

6 3 3 

ss 

3 12 

3 3 3 


2 12 

0 3 3 

= 2X3X6 = +30 

11 3 8 


5 0 5 


0 0 6 


0 0 5 



Matrix multlplicatioii 

Consider the three simultaneous equations. 


( 2 ) 


l/i + 2ys = xi , 

3l/j + Vt = X2, 

. 2yi -f- 2yj + 4y» «= Xg. 


The equations (2) are written in the expanded notation. If the x’s are known, 
the equations may be solved numerically for the y’B. As an example, let 
Xi*!, xj™3, Xj“2. Solving the equations simultaneously. 


2/1 ■= -IS, 


1/2= }i, 


2/2 = 1*1 . 
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multiple-fa (mm axai-vs is 

X .Worn, it is convenient, as well as clarifyinK, in r<-|.n-.wrnt ti set 

■ la rcclansuhr ,wlaU<'n wliioh is l„ 

to ooeffldente ot to «.« s.muUan,.,».s huve 


Table li 


I 

1 2 0 
0 a 1 

2 2 4 
A 


X i 




been arranged in the form of a matrix that may dem.lnl A . TW u'>^ linve 
been arranged in a vertical column in a matrix dcm.ted y. I li.^ -r s an* ah» 
arranged in a vertical column matrix denoted a:. Ihc nuvtrix d i» of order 

3 X3, while the matrices a: and 1/are both of order 3X1. 

A matrix that consists of a single column will be culled a rolninn irittff. 
A matrix that consists of a single row will be called a row fcdor. Tlii* vec 
torial terminology is probably due to the fact that the elements in any array 
may be regarded as the Cartesian co-ordinutes of u point in a spare, of us 
many dimensions as there are elements in the array, lids poiiil, tonether 
with the origin, determines a direction in space,. In tins munrier any array 
of a matrix can be given a vectorial interpretation. 

The three matrices A, y, x, of Tahk 11 may be regardrd as f*yiiibol»/in|{ 
the simultaneous equations (2). This neccsaitiites tliul a partiridar opora- 
tion be implied by the adjacent matrices A and y. In ordi*r lli.at ibrnr ma¬ 
trices shall symbolize the simultaneous equations, lh(‘ followiiiK nib* nnihl 
be implied in Tahh 11: 

The first equation in (2) can be produced from tiie malrirrs l»y writing 


(3) 


Uiiyii ■)" O'aVn "H Oijy*! “ — J'lj • 




In performing this operation with tlie matrices, a row of ihc. tir.sl one is 
associated with a column of the second one. The first ecpiation of (2i (•idl.‘< 
for the cross products of the corresponding elcinenla of llu? first row of .1 and 
the first column of y. (In the present problem, y has only oiui column.) Tin* 
cross product is illustrated by (3). 

The second equation (2) is produced by porfonning tlie siimt* inir hi- 
column multiplication, using the second row of A and the first (‘•iltmui of //. 
Then we have 

s 

XtiVa + Oail/ji + day SI = ~ Tsi . 


(4) 



MATHEMATICAL INTRODUCTION 


15 


The third equation (2) is produced by a similar operation on the third 
row of A and the first column of y. The sum of the three products ia record¬ 
ed in the third row and first column of x. The equation is 

3 

(5) «ai2/u + Ojiyii + diat/Bi = ^^Oiiyn = ajji. 

The three eciuations may be written in the more condensed form 

3 

( 6 ) '^auVik = Xik . 


This interpretation of two adjacent matrices is called mairix muUiplieation. 
In the present problem /c=l, because y has only one column. Since i can 
take three different values, namely, i=l, 2, 3, the equation (6) represents 
all three of the simultaneous equations in summational notation. Table 11 
represents the rectangular notation. The three equations (2) may also be 
represented conveniently in tho still more condensed matrix notation, 
namely, 

(7) Ay=>x, 

which ia a matrix equation. The operation specified by this matrix equation 
is that if tho mairix A is multiplied by the matrix y, row-by-column, the 
matrix product is another matrix, namely, x. This is an exceedingly power¬ 
ful metliod of handling sets of equations, because many otherwise tedious 
numerical operations can bo shunted, so that the calculations are performed 
only on a final act of matrices rather than on many intennediate steps, Still 
more important is tho fact that significant relations in a problem are con¬ 
spicuous in the matrix notation but they may be obscure when the prob¬ 
lem is handled in expanded algebraic or numerical form. 


Tahh n 

3 •' 

k \ ui vt vt \\ IM ° ^ 
y' / 2 3 2 

II 0 1 4 

A' 


k I! Xi Xt Xi |[ 

x' 


Tlio same sot of .simultaneous equations (2) may be represented by the 
matrix multiplication shown in Table 12. The multiplication of the first row 
of y' (j/' htis only one row) and the first column of A' reproduces the first 
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*• nf a) It should be noted that the matrices of Table 12 arc the 
SpL of of Tabte 11. The transpose of a column vector .s 

^ nS^n -trix multiplication of Tabic 12 is 


( 8 ) 



Xki • 


The general element of A in TabU 11 ie a«. Hence the geneml element of A' 
in rSie IS is ojt. The general element of y is j/it, so tliat tlie gtnrral elc- 
ment of y' is y*,. The matrix equation for TabU IS is 


(9) 


y'A' = *'. 


which represents the same set of equations as (7). 

In order to multiply one matrix by another, the mimlMsr of columns of 
the first one must be the same as the number of rows of the second. The c( tl- 
umns of A in Table 11 are represented by the subscript;, and this is also the 
subscript for the rows of y. If the sulworipts for the first matrix are t and j 
and the Bubsoripts for the second matrix are; and fc, then the ; aulweript is 
eliminated from the matrix product which has the subscripts i and k. The 
same rule can be verified in the matrix multiplication of 7 IS, where the 
subscripts of the first matrix are k and ; and those of the sccoml matrix 
are; and i. F.1iTninH.tiTig the middle subscript;', which is common, the ma¬ 
trix product has the subscripts k and i. 

The matrix equations (7) and (9) iHustrate the following matrix thcetrem: 

Theorem: The transpose of any product of matrices is the product of their 
transposes in reverse order. 

Hence, if AB*C, it follows that B'A'=C'. Applying this tlieorein to tlic 
present example, we have, by Table 11, Ay=x, and, by the theorem, y'A' 
=a:', which is the matrix equation for Table IS. 

If the ®’b are known in (2), then the y’s may be found. Ixit the j/’s Ih! 
expressed as linear functions of the 2*8 in (10). 


( 10 ) 


Si = Vi , 

22j +Zs = J/s 1 

= y*. 


(Si +2sj 
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This act, of simultaneous equations is represented in Table 18. If the three 

Table IS 


1 0 1 


*1 


2/1 

0 2 1 

• 

% 

- 

2/1 

1 2 0 


Zl 


2/1 


1^ z y 

matrices of Tabic IS are denoted B, z, and y, w© can represent the three 
equations (10) in the single matrix equation, 

(11) Bz = y . 

Since the y's are known, the values of the z’s can be determined. Substitut¬ 
ing lire known values of the i/’s in (10), we find that 

2i=>-A, 2j=i’o e»=-h- 

Equalion (7) shows that the can be expressed linearly in terras of 
the y'a. Equation (11) shows that the y’s can be expressed linearly in terms 
of the z's. It is desired now to express the ®’8 directly in terms of the z’s 
witlinut the intennediate y'a. This can be done. From the equations 

(7) Ay = X , 

(11) Bz ^ y , 

it follows that 

A (Bz) = X , 

ABz =» X. 


UtAB^a. Then 

(12) Cz X . 

In order to exprcRs the »’a in terms of the z's, the matrix product AB=C 
must (htterrained numerically. This matrix product Is shown graphically 
in Tahk Consider the first row of A and the first column of B. The cross 
product is 


(1)(1) + (2)(0) + (0)(1) « + 1. 



1 oTit in the firat row and the first column of the 
as another example, the second row of .1 and 

L third column of B. The cross product is 

fOVll + (3)(1) + (1)(0) = + 3 ■ 
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This is the element cjj in the matrix C. 


Table U 


112 0 


1 0 1 


1 4 3 1 

0 3 1 

• 

0 2 1 


1 S3 

II 2 2 4 

A 


1 2 0 
B 


6 12 1 1 
C 


Since the numerical values of the *'s. the y's. and the e’s known the 
matrix equation (12) may be tested graphically, ns shown in i nhh /.. A, a 


TahU IS 


14 3 


- 1*4 


11 

1 8 3 

• 

iV 


3 ! 

1 

6 12 4 


" 1*4 


^ 1 


C e X 


sample check, consider the second row of C and the first colimm of It. 
should reproduce the value ®ai=3. 


(1)(-A) + (8)(r4) + (3)(- = + 3 • 


Table 14 shows the matrix product AB=C, If the order of the iii!itrii'i*s 
A and B is interchanged in this multiplication, a different product is oli- 
tained. This is readily verified numerically in Table 14; and it illustriil«‘s the 
principle that if AB = C, then, in general, BA^C. Matrix multiplication is 
not commutative. In matrix algebra it is essential to note the order of the 
matrix factors because the order is not arbitrary, as in ordinary alKchra, 
where ab=ho. 

The following is an example of matrbe algebra. If, instead of (7) and (11), 
the transposed forms of these equations wove used, we should have 


if A' = a:', 


(9) 

(13) 


t'B' = y '. 
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SubstilutitiK (IH) in (9), wo have 

(14) z'R'A' = i'. 

Bnt 

(15) ABsC. 

Ilonco 

(16) B'A> = C . 

SulistitutinK (16) in (14), wc obtain 

(17) 2'C" = x ', 

which oduUi alHo bo writtiMi directly tus the transposed form of (12). 

In order tliiit thciro Khali be a tmique solution for the simultaneous equa- 
tion.s (2), the matrix A of the ctKJfticlents iniwt be non-singular, i.e., \A\ ?««0. 
Thi.s may be tested by trying to «(tlve a set of non-hoinogeneous simultanc- 
ons eqnatiiinH with «cK‘fficienls who.se determinant does vanish. 

The mulliplicatitin of matrices is sissociative. This is illustrated as fol¬ 
lows: 

(.irk; = A(RC) = ABC , 

The malrix produtit (AB) may Ik: determined and then puslmuUiplied by 
(', or the m.’ilrix iirndnct (RC) may be determined and then prcmullipUed 
by.-l. The product is the .same. This principle can be extended to any 
number ttf matrix factors. For example, 

(.-1R(.')/1 --= (ABKOD) = AiBCD) = ABCD. 

Note that the. onler of the matrix factors is retained. 

The sum, or differmteti, of two viXn inatrices is the mXn matrix each of 
whose elements is (he sum, or difference, of the corresponding elements in 
the given matrices. 
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The components may be written in any order. 

A + B =• B + A ; 

(^A + B) + C = A + iB + C) = A+B + C. 

If k and m are scalars, then 

M » HA + B); 

kA + mA => (k + m)A . 

The multiplication of matrices is distributive. 

A(B + C) = AB + AC ; 

(B + C)A = BA + CA . 

It can be shown that the rank of a mairix product cannot exceed the lowcet 
rank of any of ihe /odors. Thus, if the ranks of matrices A, B, C are 
2 , 4, and 3, respectively, then the rank of the matrix product ABC cannot 

exceed 2. . 

It is sometimes useful to know that the determtnanl of the product of Iv'o 
square matrices is equal to the product of their determinants, The followiiiR ia 
on example: 

2 6 

LetlA|= =-10, andletlB|= - S . 

IT 9 <1 I 


Then 

22 20 

1A| ■ |fi| = lABl = = - 50 = (-10)(+5) . 

29 32 


In the matrix product AB, the matrix B is said to be premuUiplied i)y the 
matrix A, or the matrix A is said to be postmuUiplied by the matrix Ji. 

The operation of multiplying one matrix by another can be summariztid 
for mnemonic purposes in the diagram of Figure t. This diagram shows 
that rows of the first matrix are associated with columns of the second 
matrix and that the middle subscript is eliminated in the product. If Ihi* 
ith row of A is cross multiplied with the kth column of B, the cross product 
is recorded in the cell ik of C. 

There is nothing magical or profound in the particular rules of matrix 
multiplication that have become conventional. The rouyly-column rule is 
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entirely arbitrary. It would have been possible to set up a oolumn-by-row 
rule provided that the matricca had been so arranged that the rule would 
have reproduced the original equationa which the matrix notation represent- 



Figube 1 


ed. It woulti also have been possible to have a notation which implied that 
one matrix was on top of another, but this would not have been so conven¬ 
ient f(}r writing hnljits that go from left to right. 

Diagonal matrices 

In the manipulation of syatems of eqtmtions there occurs frequently a 
ty}W of matrix in whielj all of the elements are zero except the diagonal ele- 
rnents. A matrix in which only the elements of the principal diagonal aro 
non-vanishing is called a dingmml matrix. The following is a diagonal ma¬ 
trix of ftrder 4: 


n tl 0 0 
0 h 0 U 
Q 0 c 0 
0 0 n d 


- I) 


a diagonal matrix. 


It soinetimc.s hupiams that all of the elements of a diagonal matrix arc 
identical. Such a matrix is called a sralar matrix. The following is an ex¬ 
ample: 

k 0 t) n 
0 Jt 0 0 
0 0 Jfc 0 
0 0 0 i: 


K " a walar matrix. 
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ir. /inch diagonal cell, it ik called a 
When a diagonal matrix following is an identity matrix of 

^ or the .■*»»» >»*'■ Th» 

erferi; u j „ q 0 


0 10 0 
0 0 10 
0 0 0 1 


= J — the idcnlily nialrir. 


11 U U V * II 

The preperUe. of diagonel meWee. «e vo„ ueoful in „f 

“"rSSicetkm BA -a e di»«on.l meWx D muUipIie. o„eh ™.. 

-Hx B n-nhiph. 


p 0 


a 1 


np hp II 

0 q 
D 


c d 

A 


cq ilq II 
DA 

II a f) 


p 0 


1 dp M 1 

II c d 
A 


0 q 
D 


1 ap 'k II 

AD 


31 Premultiplioation or poatraultiplication with a Hcular matrix A mul¬ 
tiplies all elements of A by the constant element of K. This is n si>r{’ial ease 
of the firat two theorems. The reason why prcmultiplication with a scalar 
matrix has the same effect as postmultiplication is that if every row m mul¬ 
tiplied by a constant p, the effect is the same ns if cverj' column is mult iphcd 
by the constant p. In either case every element of A is multiplied by p. 


a b 

•1 

P «| 

II ap bp 1 

0 d 

|l 

0 p|! 

II op dp 1 

A 


K 

AK 

p 0 

• 

a h 

ap hp 

0 p 


c d 

cp dp 

K 


A 

KA 

11 p 0 

■ 

a b 


II 0 p 


c d 

1 h d 

K 


A 

pA 
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Sirict* tl»c cfTcct of :i scalar tiialrix is indp-pendcnt of its position before or 
aft(ir the other inalriiH^s in a matrix product, its constant element p can be 
used in the product instead of the scalar matrix K as shown in the third ex¬ 
ample. This illustrates the following theorem: 

4 ) If K is a sindar matrix, then its constant element p may be substituted 
for the. .scalar matrix iit a product. 

AK ■= KA = pii = Ap . 

A multiiilicr which i.s independent of the non-commutative rule of matrix 
algebra i.s ealleil a arnlar, 

5 ) To multiply a matrix A hy a .scalar p, in either order, pA or Ap, is to 
multiply each ehunent of .4 hy p. 

Tlie identity matrix is a .special case of the scalar matrix, and hence it is 
also independent of the iinn-commutative rule of matrix multiplication. 


! 1 (1 

'■ 

.1“ ‘ 


a, b 

11 1 

I 

lU d 

A 


11 

i!« t 

■T “ 


a b II 

lie d 

A 

ilo 1 

I 


c d II 
A/ = A 


(i) 'I’o mulliidy a lualrix A hy the identity matrix, in either order, AI or 
I A, is to re]ir«fduee the matrix A unaltered. 

AI = lA = A . 

The idisUity matrix I in matrix algebra ct»rre.sponds to unity in ordinary 
algelini. Hence the identity matrix is suppressed, just as unity is suppressed 
in oniinarv algebrii. 

1X5 = 5, 

1 X * = a:, 

IA = A . 

The inver.se 

If a matiix -I is mm-singular, i.e., lAjs^O, then there exists another 
uniiine matrix such that its multiplication hy A produce,s the Identity ma¬ 
trix. This other iiuttrix is called the inverse of A, and it is denoted A 
Henc.e, if A i.s non-.singular, 


AA"' = I . 
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The inverse of A~^ is A, so that 

AA-^ = I = A-^A . 

Consider the ordinary algebraic equation, 

a® = y. 

If it is desired to state x explicitly, the equation is ordinarily wrilU-n as 

1 

x = - V . 
a 

If the given matrix equation is 

AB = C 


and if it is desired to write it explicitly for B, this cannot be accomijlishcd 
by ordinary division. A matrixTis not a number but a rectangulur fable of 
numbers. There is an operation in matrix algebra which ct»rire.«i)t)ntls tn 
division in ordinary algebra. If both members of the matrix equation .4 ti 
=C are premultiplied by we have 


But 

Hence 

or 


A-^AB - A-'C. 


A~^A « I . 


IB = A-'C, 


B = A-'C. 


This is the desired form. This example illustrates the operation in matrix 
algebra which corresponds to division in ordinary algebra. It consists in 
moving a premultiplying or postmultlplying factor from one raeznl>er of the 
equation to the other member in the same relative position. This oix'ration 
is illustrated in the following examples: 

If 

ABC = M , 

then 

BC = A-'M, 

C = S-'A-'M 
CM-’ = B-’A-' , 

CM-’A = 5-’, 

M-’A = C-’B-’ 


1 
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Since this opertition is analogous to ordinary division, the inverse of A is 
sometimes called the reciprocal of A. 

The inverse of any product of matrices is the product of their inverses in 
reverse order. 

Let ABC = M , 

BC » A-'M, 

C = , 

I = , 

iV-i = . 

But 

(A/iC)-‘ = AjT-i . 

Hence 

(ABC)"' = C-'S-'A-'. 

A molhod of writing the inverse of a given matrix is as follows: Let the 
given matrix Iw A with elements o,-,. 

1 ) Write the matrix Af with chmicnts ?»,•; which are the first minors of 
the elenuinlH m,; 

2) Heverne the signs of alternate elements of M so that it becomes the 
matrix K with elements ea’^i—iy^hnu; 

3) Write, the tran8p<ec of E, namely, E'=l'\ with elements/v,=<!;,•. The 
matrix F is the atljoint of A; 

4) Divide each element of F by the value of the determinant j A1. This 
is the inveme A“‘ with elements 


The writing of an inverse will be illustrated by the numerical example of 
equations (2). The given matrix equation is 

Av - a;. 

It Is dcHirtnl to fincl the inverse of A so that the equation 

y “ A"'® 


may be written in numerical form. 
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12 0 

0 3 1 =A; |Ai=+14. 

2 2 4 



10 

-2 

-6 


8 

4 

1 

n 


2 

1 

all 


10 

2 

-H 


- 8 

4 

II 

cn 


2 

-1 

3 II 


10 

-8 

2 


2 

4 

-1 =F, 


- 6 

2 

3 


u- 

-A- 

A 


I®! 

A 

-A =A">; 

— 

* 

A 

A 


It is of interest to verify numerically the matrix equation y “ A \r. It is 
written in rectangular notation in Table 16, 


Table 16 



In a later section of this Mathematical Introduction will lj« found a prtir- 
tical computing method for the inverse. The method descrihf.d abivo in not 
suitable for matrices of large order. 


The characteristic equation 

The cbaiinita^tic equation is of considerable theoretical interest in fac- 
q-p^j^^Mears in several of the fundamental factor prohletns. 


TO presentation 


^cribed in this introduction. In a more complete 
whis subject, the eharacteristio equation should be 
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jnlroiluccd with soihr gwiinfttric and td-hcr interpretation, so that the sig- 
nifieance of this equation might ho apparent. The relation of the charac¬ 
teristic equation to the prohlems of factor theory will appear in later 
chapters. 

If a constant P i-s Htlded explicitly to each diagonal clement of a square 
matrix vl, the nwulting matrix is called the characteristic matrix of A. It is 
ilhwlrated a.s follow.M; 


fill Mil Mij 


1 0 0 


(mii+^) Ok ttia 

fill Mil MiJ 

+ a 

0 1 0 

tss 

Mil («2i+i8) <*28 

aai Mji Mas 


0 0 1 


«3i Ojj (aa3+^) 


aai Mm il il » " J' II II 

(A+pl) 

Characteristic matrix of A. 


The determinant of the characteristic matrix is the characteristic determi¬ 
nant i)f .4. 1 . 1 • 1 

'riu' expansitin of a (•haracteri.stie determinant of order r is a polynomial 

of degree r. Wlien this petlynomial is set equtil to zero, the equation is called 
the rhararUthtir niualUm of A. An example is the following equation; 


(If/f) 0 1 

1 ( 2 +« 1 

1 0 (2+|3) 


=0 . 


When the dideriiiinant is expanded, the characteristic equation becomes 


+ 5 ^* + 7P+ 2 = 0. 

The coefiieient.s of the cxpan.sion of a characteristic determinant can be 
written in terms of the principal minors without expanding the whole de- 
terminanl. I-et the characteristic equation be as follows: 


(18) 


fi' -t- + wij/S'"* + .. • -f Wr - 0 . 


Then the coefficient ni, is the sum of all the ®-rowed principal ™nors m A. 
The fi(H!ffit!i<>nt »n is tlie sum of all the l-rowcd principal rnmors of A. T es 
an! 1, 2, 2, and the, sum is +5. The coefficient m, is the sum of all the 
2'rowcd principal minors of A. These are 



2 1 


i. 21 _ 10 2 

riOffli'y uocuTnetiti 


= 4. 
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The ooeflSoient ffi2=2-f-l-l-4=-f 7. The coefficient mt is the sum of all nrin 
eipal minors of order 3. This is the determinant | AI and its value is 

+2. The coefficient of the highest power of jS is unity. These coefficientii 
can be verified by expanding the determinant. 

Another method for finding the coefficients of a characteristic countion 
The summational notation 

'"‘r '* '"■““*«! In 

*1 + ®2 -f a:i -f- • • • + aTn =* y . 


specially indicated. It is accentnble nrAmf ■ ««« Im 

without subscripts when the usual form T ^ write I'x 

is implied. In fretor ^aly^B t^sIS 

ambiguous because summation may be over th^ notation Irccorncs 
tioHj or over the variables It is tSs t ^sotors, over the ptipuia- 

biguous double-subscript notation advisable to adopt the unam- 
As an example. thHum of si! * conventional in mathematics, 
written in the?o;rn row of Table S can lie 


Uii + Ou -I- ai, + 


■t-- 


ttet:”***"" ““ ^ to ^peeaent 

»« + «« + «,. + + 
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This notation means that the a'a are to be summed for a fixed value of i 
since ^ does not occur in the summation. The a’s are to be summed in one 
row t for all the column values of j from 1 to n. 


+ 0 */ + Oj,- + 


• + AmJ = 

t^l 


Here it is the column j that is Hxctl imeauso it docs not occur in the summe, 

tion sign. The o s are to be summed in some speoiiied column j for all values 
of I from 1 to m. 

If It is desired to designate the sum of all the elements in the matrix, each 
of the ,n-row sums must be summed. This involves a summation over both 
I and J. We then have 


Sum of all elements in A 


t-1 y-1 


Since it (hws not matter whether the rows are summed before the columns 
or vice versa, we have ’ 


n frt 


/«l iwl 


m n 

<-i y-1 


OiV • 


A matrix multiplication can also be designated by the summational no¬ 
tation. Consider the matrix multiplication AB~C ot Table 17. 

Table 17 


■' 1 "’ *{!') *(p) 


Km) 

Oil Dll «ii 

Oil a« Oil 

/(n) 

&II bii bii 

t^i bjt t,i 


®il Cu Cia 

<^9l Cll Cjl 


Oil an an 

o«i an a,! 


i'll bn bn 


fill C|l Cll 

Cll fill C|| 


A U AB^a 

IrCt A tie a matrix of order mXn with general element a^. Let 5 be a 
matrix of order nXp with general element li,*. Then the product AB=C 
must tic a matrix of order wXp with the general element Ci*. The middle 
subscript j for the general element disappears in the product, and so does 
the middle dimension n in the product (77iw)(?ip) = (?ttp). In the example, 
m=!4, n»=3, p»3. 
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The element Cn is obtained by the cross multiplication nf flic iirst, row of 
A and the first column of B. In summational notation, 


( 21 ) 


n 

aiihii + Oiahsi + ^ “ *’o ■ 


The second row of A and the first column of B: 


( 22 ) 


n 

Uaihii + flaallii + djjhai = “ <”81 


/-I 


The ith row of A and the first column of B: 

n 

(23) dabii -1- fla&ai -|- fliahai = x • 


The ith row of A and the fcth column of B: 


(24) Ciahk + fflaha* -h a,ahst = ^ “ <’ik • 

>-» 

The summation of (24) gives a single element in C. If it is (iesiit’il to iruli- 
cate the sum of all the elements in the ith row of C, the .summation will !«• 
over k with a fixed value for i. We have then 

*=i j=i 


Finally, if the sum of all the elements in C is to be inrlicated, the .s\iniriuition 
must also be made for all rows. Then 


( 26 ) 


in p n 


m p 


2 S ” 2 2''-* • 

1-1 fc-i ;-i f„i 


The summation of (24) represents the multiplication of two matrices, «(/ 
and bjH, whose product is the matrix c«. It can bo visualized in Fioure 1. 
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As an examplo of manipulation with the summational notation, consider 
the first term of equation (12-i). It is 



in which it is desirocl to stibstitute 



1, 


in order to simplify the first term. 

Since the order of summation is arbitrary, the order of the summations 
may be interchanged. Then the first term becomes 


m«<i i^i 




Since the sub-script i doe.H not occur in aj„„ this factor is a constant during 
the summation over i. Hence, it may be placed in front of the summation 
over i witlunit altering the value of the first term, which then becomes 

r N 

Vf*. 

mmi i'otI 


But the reciprocal of fV is a scalar, and so it can be placed anywhere in the 
summation, ('hanging its relative position, the first term becomes 



and now the substitution can be made more clearly. Suppressing the part 
which is equal to unity, the expre.ssion simplifies into 



rfiMi 


The.sc steps are more explicit thim will ordinarily be found necessary, but 
they illustrate further the manner in which the summational notation can 
he handled. 
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Linear dependence 

A matrix of order mXn may be regarded os m sets of niiinliors with n 
numbers in each set. Each row of numbers is then a set. Table IS is a mat rix 

Taibk 18 


2 

3 

5 

1 

4 

2 

4 

6 

10 

2 

8 

4 

1 

a 

3 

0 

3 

1 

2 

1 

6 

9 

15 

3 

12 

(i 


of order 4X6. In this table every row can be expre.s.sed linearly in Utrnm of 
the first row. By this is meant that for any row % there exists a constant cj 
such that 


(27) ffltV “= Cjffli; . 

For the fourth row the constant c< is 3, so that each element iti the fourth 
row is three times the corresponding element in the first row. When any 
row can be so expressed in terms of the first row, the rows arc proportinmil, 
and it can be shown that the columns are then also proportittnul. If tWf> 
rows are not proportional, they are said to be linearly in^pendail, for one 
of them cannot be expressed linearly in terms of the other. When each row 
can be expressed linearly in terms of one row, the rank of the matrix is 1. 
This means that all second-order minors vanish. This fact i« r(?tuUly verified 
in Table 18. 

The idea of proportionality can be generalized to two or tno«; tlimeimionM. 
An example of rank 2 is shown in Table 19. In this matrix any row cun he 

Table 19 

7 5 4 6 7 2 

2 2 0 4 2 4 

5 4 2 G 5 4 

9 7 4 10 0 6 

expressed as a linear function of any two rows. In this particular matrix 
there are no two dependent rows. This requires that two oonstantH ft and 
cs (not both zero) exist such that 


(28) 


= CiUii + aotf, 


where the elements in the fth row are expressed linearly 
first two rows. 


in terms of the 
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In the following example the two constants for the third row of Table 19 
are determined. For the first two entries in the third row, 


(29) 


I 5 = 7ci “h 2ca I 
I 4 = 5ci 2cj, 


Solving (29) simultaneously, we find that Ci = 1/2 and ca=3/4. Testing this 
on the last column, os an example, 

(2)(i) + (4)(5) = 4. 


A different set of constants must be determined for each successive inde¬ 
pendent row. 

Since each of the rows in Tahk 19 can be expressed linearly in terms of 
the first two rows, it can bo shown that the matrix of Table 79 is of rank 2. 
This implies that all third-order minors vanish. As an example, the fol¬ 
lowing third-order minor of TaHle 19 vanishes. 


6 6 7 

4 6 5 

7 10 9 


=0 


It con be shown that if the rank of a matrix is r, then there exists a set 
of r columns, or rows, in terms of which each column, or row, can be linearly 
expressed. 

Geometric interpretation of linear eq,uatlons 
The most frequent form of equation for a straight line in a plane is prob¬ 
ably 

(30) y =■ mx + p , 

in which x and y are the two variables while m and p are two independent 
parameters. This agrees with the well-known fact that any two points de¬ 
termine a straight line. The multiplying constant m is the slope, and the 
additive constant p is the j/-intercept. In the present context it will be more 
useful to begin with the equation of a straight line in the more general form: 

(31) 01*1 -f- ojXj -h fc “ 0 . 

This equation has two variables, a?i and a?*, and three parameters, oi, fls, k. 
Since only two points are needed to determine the line, it follows that the 
three parameters are not independent. 
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Equation (31) can evidently be multiplied by any arbitriiry constant 
without affecting its geometrical representation in the plane. Then (31) 
becomes 

cffliii -f- cfltXj ck = 0 , 

Let the multiplier c be so chosen that ihe sum of the squares of the cm.ffwieuts 
of the variables is equal to unity. Then 

(33) 1 < 
or 

(34) 


1 

I'^a? + a? 


Let cai=X); caj=Xj; ck=d. Then 


(36) ^1*1. + -H d = 0 j 

where 

(30) XJ + = 1. 

When the equation is written with this adjuatmont, it, is .‘laid lo U; in 
normal form. This definition is applied not only to the Cfiualion of a line 
In a plane, and to the equation of a plane in a space of three diiuensiotis, 
but also to the equation of a hyperplanc of (n—1) dimensi(mH in a space tjf 
n dimensions. The number of dimensions of the space chtfininl by i<t|U!itit)n 
(35) is (n—1) where n is the number of variables. Hence equatinn (3,"0 de¬ 
fines a space of one dimension, a line, in a space of n = 2 diiueiKsions, a plane. 

When a linear equation is in the normal form, the parainelcra have in¬ 
teresting meaning. The parameters Xi and Xj are the direction co-sinew of the 
normal to the linear apace which is defined by equation (35); and the 
parameter d is the distance from the origin to the same linear .‘«i)acc. The 
normal to the line makes cos-'Xi with the aJi-axis and co.s~'Xj with the Xj- 
axis. The direction cosines of a space are ihe cosines of the anyks that its normal 
makes vnth the Cartesian co-ordinate axes. In the present CitKii the Hjnii'c is a 
one-dimensional space, namely, that which is defined by eciuation (35). In 
order to avoid ambiguity, the normal is taken po,sltive on the sitUi which 
contains the origin. Equation (35) may be interpreted geomctrieally tw 
defining a space of one dimension whose normal has the direction cosines 
Xi and Xj and which is distant d from the origin. 
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If the paruineter d vnni.shes, then the spiice which is defined by the equa¬ 
tion contiiins tlie origin. In equation (35) the lino contains the origin if d 
is ZW). 

Equation (35) Iffrales a one-dimensional space (a line) in a two-dimen- 
sioniil .space (a plane). If a new variable, r,, is added, the equation takes 
the form 

(37) "k “1" “H d = 0 , 

It definr'H a space of t Wf* ditncnsion.s (a plane) in a spnco of three dimensions 
with thn-e. orthftgonal axes. Here, a« Ixtfore, if the equation is in normal 
form, then d is the dist.-inec of the plane from the origin, and the three ooefii- 
cieiits Xi, X. 1 , an* the dirertion cosines of the normal to the plane. They are 
the cosine.s of (he angle's that the normal makes with intersecting lines that 
arc parallel to the ,Ti, jj, and j-i axes, respectively. 

The tlircctinn cosines have the. profKirty that the sum of their squares is 
unify. In erjuation (35) the line Is defined if the parameter d and one of the 
direction rrvsincs an- given, In equation (37) the plane is defined by its dis¬ 
tance from the. origin ami any two of its direction cosines. The third direc¬ 
tion ewine etin Is* found from fho fact that the sum of the squares of the 
direction rtwinc.K equals unity. If rl vunisheK in (37), the plane contains the 
origin. A phuu* through the origin is (herefore defined by its direction co- 
Hinca, which arc tin* lUn'ction cwiuc.s of it.s normal. 

An equation id (Im same form in n variables is 


(38) ^iJ'i '{'••• d" XxJ'n "I* d = 0 , 


It defines a liyjH'rfihine of (n ™ 1) dimensions in a space of n dimensions. If 
(38) is in normal form, d is the. di.Htance of the hyperplane from the origin. 
The X'.s are the ilin'ctioii cosines of the normal to the hyperplane and hence 


(30) 


Vx» 


1 . 


1-1 


In the pre.-M'ijt hiefor analysis the liyp'rpliines of primary interest contain 
the origin, so that the parameter d vanishes. Then 

(40) XiJi i' X?j*j ‘1 X»X| ”1“ . • . "f* XftXn " 0 I 

The n valiie.H of X< are said to Is*, the. direction cosines of the hyperplane L 
which i.H defined by its normal A. 
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A matrix may be given a geometric interpretation. Ivct the matrix A be 
of order mXn. Then the n elements of each row may he regarded as the 
Cartesian co-ordinates of a point in n dimensions. Since there arc m rows 
the matrix may be thought of as defining the positions of m pfdnts, «>ne for 
each row, in a space of n dimensions. Table iOie of order 6X3. It can there¬ 
fore be regarded as defining the positions of six points in a space of three 
dimensions. 


Table SO 
1 2-4 

-4 1 -11 

-2 -3 5 

3 5-0 

4 -2 14 

0 1-3 


Let the rank of an mXn matrix A be r. Then it can lie shown t hat the m 
points are contained in a space of r dimensions which also contains the 
origin. The rank of the matrix of Table $0 is 2. Hence the six points should 
lie in a plane which contains the origin. The equation of such a plane is 

-|- XjXi ■* 0 , 


in which the ®’s are the three co-ordinates of each of the points in flic plane 
and the Vs are the direction cosines of the plane. The X's ar« not imlcpcnd- 
ent parameters because of the conditional equation (30), Hence any t wo X's 
define the plane. These may be found by any two of the six points w>hich are 
not coUmear with the ongin. Since no two rows of Table SO are iiropor- 

collinear with the origin. If two such jKiints 

Tora £ ^ 

Substituting the x's of the first two points of Table SO in (41), 


(42) 


Xi -f- 2Xj — 4 X 3 
— 4Xi -f 

Solving for Xi and X, in terms of X,, we have 


0 , 

0 . 


(43) 


Xi ™ — 2X|, 
. Xj =* 3X3, 
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Substituting (43) in (39), 

(44) 4X1 + 9X1 + XI = 1, 


or 


and hence 




_1 

1/14’ 


X 


2 

1 B3 -—— 

1/14 

X = 3 

’ 1/14 ‘ 


} 


The equation of the plane in normal form ie therefore 


(45) 


2,3 ,1 

Vu + vTu *’ + 7u 


Xi = 0 , 


All of the four remuinlng points must lie in this plane, since the rank of 
Table 80 is 2. The three coefficients are the direction cosines of the plane, 
i.c., the direction cosines of the normal to the plane. 

The distance of a point from the origin is V S®*, where the x’b are its 
co-ordinates. Eor example, the distance of the fourth point from the origin 
is l''3’+5®+ (—9)®* 10,72. If the sum of the squares of the co-ordinates of 
a point is equal to unity, then the point is at unit distance from the origin. 

Each point may be interpreted os defining the terminus of a vector from 
the origin. The scalar product of any two vectors is hiht cos 0, where hi and 
hi are the lengtlis of the vectors and ^ is their angular separation. If the two 
vectors arc of unit length, then the scalar product is the cosine of the angular 
separation. It can be shown that the scalar product of two vectors can be 
expre.sscd in the form 


whore i and I refer to points (rows) and j refers to co-ordinates (columns). 
For example, the scalar product of the vectors defined by the second and 
fourth points of Table 80 is 


(-4)(3) + (1)(6) + (-ll)(-9) = + 92 . 
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If the sum of the squares of the eo-ordinatcs of pach point is npifsl t(» unity 
so that the points lie at unit distance from the oriftin, thru tlir soalar prod¬ 
uct, or cross product, is the cosine of the angular separation of tiie vectora 
at the origin. 


Orthogonal transformations 

The three simultaneous equations (2) may be rcgarciecl an n’pri'wiitinK 
the three oo-ordinates of a point x (* 1 , a:*, x*), the <'fM.rflinatrs fd » 
point y ( 3 / 1 , j/j, j/a), and the law by which each point ?/ is 1 rati«foriin>(l into a 
corresponding point z. For every point y, there exists some rnhrr p„int * 
whose co-ordinates cm be found by (2) when the co-onlinjiles of » are 
known. This relation is called a linear transformation by which th(^ tioints u 
are moved to the corresponding points x. Every pair of tiie com'.stMmdimt 
pomte IS related by the linear transformation (2). The fmn.sformafion is 
called hrmr when the equations by which the x’s can l«j fouiiil from tin’. 
y s are of the first degree, as is the case in (2). 

U the transformation is of such nature that the x’.s can Ih! obiaincd 
rom the y s by merely rotating the co-ordinate axes, then flic Iraiisfornm- 
tion IS an orthogonal tramformation or rotational transformation. In order 
t^tatraMformation shall be orthogonal, it is evidenfly nccc.ssurv that Ilu> 

the distance of a point from the origin remains invariant wlicmhc ro-ortli^ 
axe. are .otekd, II i. . 1.0 

oalar products, be invanant, because the configuration of the poinls is iuit 
altered by rotating the co-ordinate axes. ‘ ‘ 

The matrix A of Table 11 is called the matrix of the transformation when if 

“»o"* y arV;z,jri,dlrz 

UIA 01 1 aote 41. It can l>c shown that a sijnurc maf ri.v is 


Tabu m 


On 

Oh 

Oil ... 

0|. 


Oi] 

Oil ... 

0|. 

aji 

Oil 

Oil ... 

Ol. 

Onl 

0.1 

... 



Of points x,’i^ththfsLtc<S^^^^^ ‘‘.f V 

conditions: ^ 2 / s. if it aalisfios tlip following 
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1) Tho sum of the squares of the elements in each row is equal to 
unity, i.e., 

n 

(46) = 1, 
and 

2) ^i'he cross product of every jiair of rows, i and I, is equal to zero, i.e., 

H 

(47) ^aoai,- = 0 , 

ja»l 

when ipf-i It is iiniuatcrial whether the rotation is conceived as a rotation 
of the ortlujKonal co-ordinate axes in a fixed configuration of points or as a 
rotation of the configuration in a fixed reference frame of the co-ordinate 
axes. The residt i.s the same. 

Th(^ two c.ondit ion.s, (40) and (47), are of such frequent occurrence that 
it is .somotiincs convenient to comhinc them in a single statement. This can 
lie done liy writing the conditions in the more condensed form 


(4«) 


n 

5il ~ I 


where the syinltol on is known as Kroneckcr's della. It is defined as follows: 

Oil = -h 1 when i = I, 

0,1 = 0 when i . 

It can he seen that with tliis definition of 5,-j, the single statement (48) 
covens the two stalemontH (46) and (47), 

If the matrix of a transformation is square and if it satisfies (48), then the 
following eonililiuns are also satisfied: 

3) The .sum of tlie wpiares of the elements in each column is unity, i.e.. 


ft 





( 40 ) 
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4) The cross product of any pair of columns is zero, i.e„ 

n ^ 

(50) = 0, 

■fill 


where j and k refer to columns. 

6) The determinant of the transformation Is ± 1, i.e., 

(61) |A1 = ± 1. 

If an orthogonal oo-ordinate axis is reversed in direction, then the corre¬ 
sponding co-ordinate for each point is reversed in sign. If an odd nuniljcr of 
orthogonal oo-ordinate axes are reversed in direction in an orthogonal trans¬ 
formation, then the determinant of the transformation is ccjual to 1. If 
an even number of axes are reversed, the determinant is G(]Ual to +1 • T hose 
two statements can be made with reference to the configuration. If the ro¬ 
tational transformation retains the configuration of the points, the rletertni- 
nant of the transformation is equal to -f-l. If the rotation involves a »ym- 
metrio distortion of the configuration, the determinant of the orthogonal 
transformation is equal to — 1. 


a 1-2 
6 2 3 

c -1 4 

d 6-2 

9 4 1 

A 


Tabu «« 


Ft y, 


r. 

y, 

,860 -.600 

a 

- .134 

a* 

.500 .806 

b 

3.232 

1 .ItlK 

G 

c 

1.134 

3 tHll 


d 

3 330 

-4 232 


e 

3,004 

AG 

-1,134 


Each column of an orthogonal transformation shows the direction ciMtines 
of one of the new co-ordinate axes, referred to the given co-ordinate axes. 

A rotation of the co-ordinate axes implies that the given configuration 
and the transformed configuration are contained in the same space. The 
rows of a transformatidn correspond to the dimensions of the given configu¬ 
ration, and the columns of a transfonnation correspond to the dimensions 
of the new configuration. If the transfonnation Is merely a rotation of axes, 
it is evident that the matrix of an orthogonal transfonnation is necessarily 
square. If the matrix of a transformation is of order mXn where 
then the transformation cannot be orthogonal, since the nuinlier of tlimen- 
sions of the given configuration and the number of dimensions of the trans¬ 
formed configuration are not the same. However, such a matrix may satisfy 
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condition (47), and it is then said to be orthogonal by rows. If the condition 
is satisfied for columns, as in (50), instead of for rows, then the matrix is 
said to bo orthogonal by columns. 

Table 22 is a numerical example of the rotation of five points in a plane. 
A is a matrix of order 5X2. The orthogonal transformation G is of order 
2X2. The matrix product AG = B is of order 5X2, and it shows the co- 


X, 




. 

t > 

'L/ 

V* ° 

! 30 * 

X 1 1 


\ 

\ 

\ 3 

ad 
\ 

\ 


Fioure 2 


ordinates of the same five points with reference to the new rotated co¬ 
ordinate axes. In Figure 2 the five points have been plotted for the given 
orthogonal co-ordinate axes, and Xt, that are implied in A, 

I.,et it be desired to rotate these axes through an angle 0=30". The usual 
formulae for rotation of axes* can be written in the form of a 2X2 transfor¬ 
mation as follows: 

cos <l> — sin 
sin 4 > cos 4> 

* W. F. Osgood and W. C. Graustein, Plane and Solid Analytic Geometry (New York: 
Macmillan Co., 1020), p. 220. 
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The first condition (46) gives 

cos* <l> -1- sin® (^ = -P 1 1 

and the second condition (47) gives 

cos ^ sin 0 ~ cos <i> sin 0 IJ . 

Hence this is an orthogonal transformation in which the- oilier i.ioj«Tli(‘s 
may be readily verified. 



Substitution of <^=30® in the transformation produces the inutrix (t, tmd 
the multiplication AO produces B. The numerical vahiOH in Ji may Ih! 
checked in Fiffwre ;8, where Fi and Kg have been drawn so tliiif, }'ifLYi»<#» 
=30®. For example, the co-ordinates of the second point can Ik* jiifimurcd 
on the graph to be 3.23 and 1.60 for tlic two rotated axes, while they are 
2 and 3 for the two original axes. This figure illustrate.^ the geoiiuflric in- 
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torprotiilif)!! of an ortlmunnal transformation. The two coUiinns of the trans¬ 
formation fr show the (lin'ction cosines of the new orthogonal reference 
vectors 1 1 and 1 2 - 


Oblique transformations 

In Figure 2 the t\v<i co-ordinate axes I'l and Vs are orthogonal. If it is 
desired t(» (Udine the ;i ijointa with reference to oblique reference axes, the 
transformiilioii i.s efTect(-‘d in a airnilar way. In l''igure. 3 tlie same five points 
are [dolled m the A’l and A'-j axe-s which are im[died in the given matrix A 
(tf Talk 22. IIer(! the nenv ax(\s are oldiciue; Zi is rotated 30° from Xi, and 
Zt is rotaUsd 40° frojn AY 

In Tabk 23 are .shown the numerical values for the corresponding oblique 
transformation. The matrix A contains the co-ordinates of the given five 


a 


c 

d 


e 


.V, .Ys 

1 -VI 

2 3 

-1 .1 

.I -2 

•i 1 


.1 


fabbsSS 


'/n Z 2 


Zi Zt 

,81)0 — .707 1 

a 

- .134 -2.121 1 

TilH) .707 1 

h 

3.232 .707 


e 

1.134 3.635 

II 

d 

3.330 - 4.049 


0 

3.904 -2.121 


AII = C 


[xdnls in a .si»ace (Uifimsl by the two orthogonal reference axes Xi and X 2 . 
The matrix U i.s a .H{[uarc matrix of order 2X2. It is the matrix of the oblique 
ti-annhmntitinn. Its ceJuinns show the direction cosines of the new oblique 
c(Hordinatc axe.s if. and Z*. These direction cosines may be verified m 


Figure 3. „ 1 t tj • 

It should be noted that the sura of the squares of each column of u is 

equal to unity. Each column of JI may be regarded as defining a unit vec¬ 
tor in a siiacc of two dimensions. The cross product of the columns of 
11 is 




wiiich is tlus co.sine of the angle between /. and /a. , , „ . . 

The product AlI^C shows the projection of each of the five ptiints on 
each of the oblUiuc axes Z. and Z,. This interpretation can be venfied by 
actual measurement on Figure 3, 
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A method of finding tho root* of a polynomial 
Consider a polynomial of the tyf»* 

(52) “ fo^+Cid""' + • r,. ,:;* .i r, ■ M , 

where r is a positive integer, r*?<0, ami r«. r,. r, ah< rral c’^^r-fficionu. 

The r roots, P, of this equation are desirnd iVlrninm'«!»• iip}«'r mu] lowef 
limits* of the roots of this equation. Ijf't a innl vnhu- id within tlii>i« 
Umits be K fi' is a root of the palymnnial / tlu-n hy (],«• Itunminder 
Theorem,t/(^')“0- Thenumerieal value ofrimy N- dcw-nninwlonan 
electric calculating machine by wmipuling/(,’ij ,4 .1':^ hy ihi- pnieeag of 
synthetic division.t Consider the sign of the luinu'iirnl vnhiu of //^’j and 
select a second trial root, dcaignaletl wlrirh will sivr* / ft”; opp^wite in 
sign to that of/05'). When two such trial valimj* of m an* fotnul. (hrm is at 
leMt one rootS between them. Determine a third trin! v«hm. ;t'”, hy linear 
interpolation between/0') and/(]J"). If the value«i». t hun n#'" is one 
of tber roots of the polynomial. If/t^'”) i^O, inlurii^dat'U for f*«re»'ft»ive trial 
values until that value of 0 is found for which tin* n-nmindi r, /^is, is sew 
to as many decimals as required. 

Repeat this process for each of the r rtxifjt of tlu- ]io|> it»iisi»l |,y taking 
trial values In other regions between the upper and lower liinile of the roots. 
In the method of prliiripal axes, a very iwful lir«t appioxiiMatioii f„r earh 

"I 

root, ^m, of the eharacteristk* equation is fur eru'li •-i»hirtiii»« of f, 

when Co, ci,are all positive. 

Table 05 shows the applieatiun of the method of >ytiihe{ie division in 
calculating one of the roots of the equation: 


(53) ^ + 6.965309/J* + 10.8104040* + 5 4(l73{Wj(t .f w 0 . 

The upper limit of the roots of this equation ia any ^uwoViit nundn'r; the 
lower limit is —7.005369, The first trial value 0'» ‘ fi.tUlHlT«•- - a|i, 


as found in a priuoipal-axis problem, Bmre/t^'j iamigativt',^’'’-^- r}.(}2tXX)0 
was chosen arbitrarily to secure a positive value Mnenr inlerpo- 

lation between/(0') and/OJ") gave the third trial value, 0"* ^ - fi.tUllTlO, 


a ^ /fe»i<«f«rw tXew y..Tk: J»tiw Wthy & 

Sons, 1022), pp, 21-23, 

t/l)«t.,p, 12, +n..M __ .. 


t/iiia., pp. ia-15. 


i mi, p 07 
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Linear interpolation between/(/S'") and/(^") gave the fourth trial value, 
^""=-5.010712, fur which the value of the polynomial is +.000018. 
Hence, one root of this equation is —5.019712. 

The vahuw of f{fi) in ca(!h row of Table 25 were determined by the equa- 
tion.s in their corresponding row.s of Table 24 . In actual application, it is 
po.ssiblc to carry out the r calculations in each row on a calculating machine 
without recording any of the values except the rth one in the column 
headed /(/S). 

Table S4 




/»• 


0 

m 

Trial B 



Cl 

ea 

Cl 

et 

1 



c,+c|/J'=c5 

c,+cl|9'=cl 

C4+C,'fl'=ci 

P' 

2 



ci+e."/3"=cj' 

c,+cl'p"-cj' 

c,+i4'p"=c^ 

C4+cr/3"'=c(" 

P" 

» 



c,+c't"0"'=el" 

c,+ci''j3'"-cl'' 

fl"' 

4 


=c:"' 

Cj+c{"'/3""-=cl'" 


C4+c1"'|3'"'=c1"' 

piiti 


Tabic 2S 


'IVilil 



/!» 

P 

m 

Trial/I 


o.uosiimi 

ia.81(MU4 

6.407203 

.810062 

1 

nnni 

i.imm 

1.018120 

..705081 

-.688800 

-5.011337 

2 

nmn 

1 .mm 

1.044742 

.102698 

.023810 

-6.020000 

:i 

nnn 

1 .»45(iri9 

1.04;i8jK) 

.107379 

-.000142 

-6,019710 

■■ 


1 .'J-I.W 

1,04.8850 

.167347 

.000018 

-6.010712 


A method of computing the square root on a calculating machine 

Newton’s* iterative method of determining square roots may be used 
very advantageously on the calculating machine, using Barlow's Tables to 
determine the first trial value of the square root. 

I^et N bo the number whose square root is desired, and let *0 be the first 
trial value for the VN derived from Barlow’s Tables. Determine N/xo on. 
the calculating machine, and record it. 

Compiite a new trial value, xi=,5{xe-^N/x^ by determining the cumula¬ 
tive sum of the two products, (,6xo) and [.5(N/xo)]. Determine N/xi. If 
the two values Xi and N/xi are the same to as many decimals as desired, 
then = = If these two values differ, this process may be re¬ 
peated for as many trials as are necessary to find that trial value a which 
agrees with N/x to the required number of decimals. 

♦ 13. 'r. Whittaker and Q. Robinson, The Cakulue of Obtervaliona (London: Blaokie & 
Son, 1020), pp. 76-80. 
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N 

Example 

= 42.072 . 

Xa 

= 1 / 42.07 in Barlow’s Tables 

= (5.4801301 . 

N 


= (5.48()44738 . 

Xo 


. - 

Xl 

= .5x,+ .6(1) 

= 0.48620324. 

N 


= 6.48620324. 

Xl 




The computation of an inverse 

The outline that was described in. a previous seetitui for conipiitinK an 
inverse is adequate for small matrices of order 2X2 or <3X'i, l>ut it is tutt 
economical for larger matrices. The outline of coinput atioiis wliich will be 
described in this section is applicable to iuatri(’C.s of any order, uiid tlio 
computational labor is not prohibitive oven when the tirrler is as large ns 
10 or 12.* 

The method is designed to find the inverse of a syiiimclrie iiudrix, which 
may be denoted M, If it is desired to find the inverse of a nou-syiuiuetric 
matrix P, one can proceed as follows: Compute the matrix /'/" - .1/, which 
is symmetric. Find the inverse M~^ of the syrniiictric matrix by the 
method to be described here. Then compute the matrix product (M' 'Py. 
We then have 

(54) = [(PP')-'Pr 

= [(P')->(p-‘/^)r 
= 1(P')-T 
= p-'. 

Hence the method can be adapted to find the inver.se of a matrix which is 
either symmetric or non-symmetric. 

In Table S6 we have a numerical example, a symmctrii' matri.x M of 
order 3X3. It is placed in the upper left corner of the table in the liml 

* The method of computing an inverse which is described in tliis setdiitn wmi tleHigiiud 
by Ledyard Tucker. See also hie paper, "A Method for Finding tiio Inverse ofii Matrix," 
Psydiomdnka, III, No. 3 (September, 1038), 180-97. 
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three rows of Heclion A. The steps in computing the inverse are then as 
follows, inclutling check columns: 


Table 20 






f'eclion li 



Seclim C 



1 

2 

3 


I 

11 

III 


1 

ir 

III 

1 

.«() 

.48 

.30 


.80 

0 

0 


1.00 

0 

0 

2 

3 

,4« 

.80 

.30 


.48 

.51 

.01 


.00 

1.00 

.02 

.315 

.30 

.80 


.30 

.14 

.00 


.45 

.27 

1.00 





('ll 

1.04 

.00 

.67 

Ch 

2.05 

1.27 

1.02 


1,04 

1.04 

l.fiS 


1.04 

.05 

.67 

V. 

2.05 

1.27 

1.02 


i.no 

0 

0 


1.00 

- .00 

- .29 


1.25 

-1.18 

- .44 


0 

1.00 

0 


0 

1.00 

- .27 


0 

1.90 

- .41 


0 

0 

l.(K) 


0 

0 

1.00 


0 

0 

1.52 





Ch 

1.00 

.40 

.44 

Ch 

1.25 

.78 

.67 

Xj 

1.00 

1.00 

l.(K) 


1.00 

.40 

.44 


1.26 

.78 

.67 





Ch 

2.04 

1.00 

1.11 

Ch 

3.30 

2.06 

1.00 

2 

2.04 

2.04 

2.58 

s 

2.04 

1.05 

1.11 

23 

3,30 

2.05 

1.60 






1.26 

1.90 

' 1.62 






1 . 01 ) - .00 - .20 
0 l.(K) - ,27 

0 fl 1.00 


1.25 0 0 
-1.18 1.00 0 
- .44 - .41 1.52 


2.09 -1.00 - .44 
-1.00 2.07 - .41 

- .44 - .41 1.52 


1. llecortl tiic column .sum.s, Si, a.s shown. 

2. In the next three row.s of A write an identity matrix. 

3. Record tlic column sums, Sj, for these three rows, 

4. Record the total column sums, S=Si+S 2 , 

.5. In cohimn I of Sedinn B copy the first column of SecMon A. Here a 
differciitiiition is made between the anticipated column sum, Ch, and the 
actual .sum, S. 

t). Eiiid the reciprocal, l//;ii = l/.80 = 1.25. The entry, tn, is the first di¬ 
agonal entry in Scdioti B. It Is the entry in tho first column and in the 
first row of B. Record this reci]>rocul in the bottom row of B as shown. 

7. Computis the values in tlu! fimt column of Bartion C. These entries are 
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8. Compute the second column of B by the formula 

bfl — 0‘ii ~ {b/iCii) I 

where cn=.60 is constant for the entire colunm. 

9. Find the reciprocal l/haa= 1/-51 - 

10. Compute the second column of C by the formula 


(57) 



11. Compute the third column of B by the formula 

( 58 ) hp = uja — 5,iCji — b/sru , 

where fl,i = .45 and c,,=.27 are constants fur the entire eolunm, 

12. Compute the third column of C by the formula 



where the reciprocal l/fias is a constant multiplier for the whole ('mIujiui. 

Continue the process in the same manner so fhiil there will Ire as 
many columns in B and in C as there are. columns in .1. The liioiernliml 
formulae are, then, 

(eo) c* - 

and 

(61) h]k = djk — [6jiCh -h 5/iCia -!-•'■+ hytt iiftii, isl. 

13. When the columns of B and of C have, been eoiuputral and chei'ked 
by the column sums, the desired inverse A/”* is 


(62) Af-= (6,..)(c,J', 

where (&gm) is the square matrix defined by the roluiuus of B iuid the iow.« 
of the identity matrix in A. The square matrix ((•,«} is delinetl hy the 
columns of C and the same rows which arc dofined by the idi'Olify miilris 
in A. Note that it is the transpose of the matrix, (r,„)', which i.s rrsed for the 
final equation for Af->. The computed inverse is .shown in the table. 

Linear dependence of vectors 

Consider two vectors A and B in Figure 4- TIumi! two vectors tlefine a 
plane, namely, the plane of the figure. These two vectors are .‘sairl to span 
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the plane of the figure. By thi.s is meant that any vector in that plane can 
be written ns a linear combination of the given vectors A and B, Any other 
vector in that plane, such as C, can then be written as the linear com¬ 
bination 

C = OfA -f- bB , 

whcu'c the .small letters, a and h, represent scalars and the capital letters 
represent vectors. Any vector C in the plane of the figure is determined 
entirely by the nunitiricul values of a and 6. Further, all linear combina- 
tion.s of A and li are. confined to the plane of these two vectors. No vector 
outside of that jilane can be described as a linear combination of A and B 



This reu.soning extends to any number of dimensions. Three vectors span 
a thrcii-diinensional .space if they are linearly independent. The three vec- 
Um A, B, and C, in Mgure 4 are not linearly independent because any one 
of them can be described as a linear combination of the other two. If three 
vectors are not eoplanar, they are linearly independent. Then they span 
a three-dimensional space. Any vector in those three dimensions can be 
described as a linear combination of the three independent vectors. 

The interpretation of linear dependence of vectors will be illustrated by a 
luimcu’ical example,. Let it be required that the vector C shall satisfy three 
conditiotiH, mutioly, (1) that it shall lie in the plane of the given vectors A 
and B, (2) that it .shall be orthogonal to B, and (3) that it shall be of unit 

length. ... 

The fhftt (.'ondition is sati.sficd if we define C as a linear combination of 

A and B. Then 


(63) 


f’ = 0/1 -f" bB , 
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where a and b are two parameters which are to hr. ,lotrmmu-d by the r.ih.-r 
Two conditions. The vector C will be orthogonal to H if iht* pnahu-t. 


(64) 

and C will be of unit length if 


C2? = 0, 


(65) 


C® = 1. 


Substituting (63) in (64), wc have the equation 


( 66 ) 


(aA + hB)B = 0 


or 

(67) a{AB) -h bB- = 0 
Substituting (63) in (65), we have 

( 68 ) a*A> + 2ah(AB) + t-/r- = 1 , 

Equations (67) and (68) can be solved explicitly fur « iiiitl h, biU, in I'mii- 
puting, it is usually simpler to write, lii-st, a vector (“ whirli is (>rlliugun!il 
to B by satisfying (67) without restriction as to its IciiKlli, hi't rj 1. 
Then b - —(AJ3)/B*. When such a vector C" lui.s been tlelennineil, il 
can be normalized, and it will then satisfy both comlilions. 

As a numerical example, consider Tabic 27 of ilireefiun nutulMss for 
A and B in three dimensions. ThenA*=0.6!);B’* —().S3;!iii(l the .'■fal.’tr prud- 


Table S7 



I 

II 

HI 

A 

B 

C 

C 

.7 

.6 

.3325 

.0763 

.4 

.3 

.1705 

.3651 

n .’I" .('lO 

■t h* .Hl\ 

— '3140 (■■th) n» .til 

-.6400 ' 

VlU'np. “ 'i.O.Ul 


uct (AB) = 0.61. If we set 0=1.00, then 6= -(AB)/B“= -O.T.'fl!), anti then 
the direction nuinbera of C can be written by ((53), as .slinwn in the (bird 
row of the table. The cross product of rows B and f■' vanish, itnd lienee 
these two vectora are orthogonal. The row (V is nest normalijied, lus shown 
in row C, and then both conditions are satisfied, namely, (‘B •; 0 ami f '* ■ 1. 
If the direction numbers of C were reversed in sign, they would di'lim* tlio 
vector Cl, aa shown in Figure 4 . This vector also .sntlslic‘.s thi‘ t wo euiulitions 
imposed. They differ in that the scalar product CM is positive,, whereus 
C.iA is negative. 



CHAPTER I 

THE FACTOR PROBLEM 


On the nature of science 


This Vfiluint) is fniKTTiied with methods of discovering and identifying 
sigiiiiicant (•at<‘goi'ii’s in psychology and in other sciences. It is therefore of 
inlcre.st to consider som<! phtusc.s of science in general that bear on the prob¬ 
lem of finding a nmthodoltjgy for a psychological science. 

It is the faith (jf all Hcicnce that an unlimited number of phenomena can 
bo coiiiprelumdcd in terms of a limited number of concepts or ideal con¬ 
structs. Without this faith no science could ever have any motivation. To 
deny this faith is to atlirm the primary chaos of nature and the consequent 
futility of .scicntilii' ctTort. The constructs in terms of which natural phe¬ 
nomena arc coinprehcudcd arc man-made inventions. To discover a scien¬ 
tific law is m(‘r<*ly to discover that a man-made scheme serves to unify, and 
thereby to .simplify, c()mprchcn.sion of a certain class of natural phenomena. 

A scieiililic law is not to be thought of as having an independent existence 
which .soiiK! scientist is fortunate to .stumble upon. A scientific law is not 
a part of uutiir(!. It is only a way of comprehending nature. 

A simple uxjunple. is the concept "force.” No one has ever seen a force. 
Only the. niovtmuiut of objects is seen. The faith of science is that some 
.schematic rcprewMitatiou is possible by which complexities of movement 
can be eoneeptually vmilied into an oixler. The error of a literal interpreta¬ 
tion of a force V(!Ctor a.s the piiitorial representation of a corresponding 
physical entity is .seen in the rasolution of forces. If a particle moves with 
uniform aecelm-ation in a certain direction, it is, of course, possible to de¬ 
scribe the movement by one force, or by two, or by three or more coplanar 
forces. This resolution of a movement into several simultaneous and super- 
imixistid moveiiumts i.s frequently done in order that a convenient and habit¬ 
ual referimce frame may be retained. While the ideal constructs of science 
do not imrily physical reality, they do not deny the possibility of some de¬ 
gree of correspondence with phy.si(;al reality. But this is a philosophical 
problem that is quiltj outside the domain of science. , , , . , 

Consider, as another ('xample, Coulomb’s hivcr.sc-squaro law of olccitrical 
attraction. A postuhil,ed force i.s expimsed as a function of the linear sepa¬ 
ration of the. clmrge.s. Now, if the charges were to be personified, they would 
probably Iks imich surririscd that their actions were being described in terms 
of their limair separations. No one assumes that there is a string between the 
charges, but Coulomb’s law implies that the length of such a string is to be 
used in our simplified scheme of comprehending tig 


ftcr' 
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ia more likely that the whole space surrounding the ehurges is involved in 
the of attraction and that Coulomb’s law is a fc»rt«nat.e short 

cut for representing approximately a part of the phenninena f liat are (’tilled 
“charges” and “attractions." It is not unlikely that all thp.se pntili(ss will 
eventual^ vanish as such and become only aspects of an order more in- 
volved than Coulomb's law implies but not so chaotic as to individualize 
completely every moment of nature. 

A science of psychology wll deal with the activities of peoph* a.s its (’('ii- 
tral theme. A large class of human activity is that which difftfrentiates in¬ 
dividuals as regards their overt accomplishments. Jiwt ns it i.s convenient to 
postulate physical forces in describing the movements of phy.sical objeids, 
so it is also natural to postulate abilities and their abstm(>e a.s primary 
causes of the successful completion of a task by some iiidividuats and of the 
failure of other individuals in the same task. 

The criterion by which a new ideal construct in science Is acct’iited or 
rejected is the degree to which it facilitates the comprehension (»f a class of 
phenomena which can be thought of as examples of a .single construct rather 
than as individualized events. It is in this sense that the chief object of 
science is to minimize mental effort. But in order that this r(;duction may 
be accepted as science, it must be demonstrated, either explicitly or by im¬ 
plication, that the number of degrees of freedom of the construct i.s sinalh'r 
than the number of degrees of freedom of the phcnoimma that the reduc¬ 
tion ia expected to subsume. Consider, as an exaraphs, any situation in 
which a rational equation ia proposed as the law governing the relation Ik‘- 
tween two variables. If three observations havo been made and if the 
proposed equation has three independent parameters, then the tmnd>(>r of 
degrees of freedom of the phenomena is the same as the number of degrees 
of freedom of the equation, and hence the formulation remain.s undemon¬ 
strated. If, on the other hand, one hundred experimentally indeptindent 
observations are subsumed by a rational equation with three parameters, 
then the demonstration can be of scientific interest. Tlie ct)nvinciiigne.s.s of 
a hypothesis can be gauged inversely by the ratio of its number of degrees 
of freedom to that of the phenomena which it has demonstrably coven'd. 
It is in the nature of science that no scientific law can ever b<? proved to be 
right. It can only be shown to be plausible. The. laws of Hci(?nco arc not 
immutable. They are only human efforts toward parsimony in (h(i com- 
prdiension of nature. 

If abilities are to be postulated as primary causes of individual diffcri'ncisH 
in overt accomplishment, then the widely different achievements of iudi- 
vidu^s must be demonstrable functions of a limited number of reference 
abilities. This implies that individuals will be described in terms of a limited 
number of faculties. This is contrary to the erroneous contention that, since 
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every person is different from every other person in the world, people must 
not be (.'lassified and labeled, 

Eaeh generalization in the .scientific description of nature results in a loss 
in the extent to which the ideal constructs of science match the indiAddual 
events of experience. This is illustrated by simple experiments with a pen¬ 
dulum, in whi(ili the mass, the period, and the locus of the center of gravity 
with rcferoiicc to a fulcrum arc involved in the ideal construct that leads to 
experimental verification. But the construct matches only incompletely the 
corrc.spoi'uling experimental situation. The construct says nothing about 
the rusty set.s(‘rew and other extraneous detail. From the viewpoint of im¬ 
mediate experience, scientific description is necessarily incomplete, The sci- 
eiitiiit always fiiuls his constructs immersed in the irrelevancies of experi¬ 
ence. It .seems appropriate to acknowledge this characteristic of science, in 
view of the fact that it is a rather common notion that the scientific descrip¬ 
tion of a per-son is not valid unles-s the so-called “total situation" has been 
engiilfeil. A .study of people does not become scientific because it attempts 
to be complete, nor i.s it invalid because it is restricted. The scientific de¬ 
scription of a person will be as incomplete from the viewpoint of common 
Hcn.s(! a.s the description of other objects in scientific context. 

The (hivolopmcnt of scientific analysis in a new class of phenomena usual¬ 
ly moots with rosistance. Tlio faith of .science that nature can be compre- 
hctwlecl in tcrin.s of an order a(!knowledge3 no limitation whatever as re¬ 
gards c.lii.ssc.s of phenomena. But scientists are not free from prejudice 
against the extension of their faith to realms not habitually comprehended 
in the Hcientific. order. Examples of this resistance are numerous. It is not 
infrequent for a competent physical scientist to declare his belief that the 
phenomena of living objects are, at least in some subtle way, beyond the 
reach of rigoroii-s scientific order. 

One of the furin.s in which this rasistance appears is the assertion that, 
since a scucntific c()n.struct does not cover all enumerable details of a class of 
phcTw»rae.na, it is therefore to be judged inapplicable. Since the analysis of 
cell growth by mathematical and phs^ical principles does not cover every¬ 
thing that is known about cells, the biologist judges the analysis to be in¬ 
applicable. Since no mathematical analysis that can be conceived would 
cover all the subtle my.steries of peraonolity, this realm is frequently judged 
to be outside the domain of rigorous science. But physical scientists accept 
ligonuis .sciontifn^ analyse.s about physical events that leave fully as much 
beyond the aci(sntifie (ton.struc.t.s. Every explosion in the world has been 
different from every other explosion, and no physicist can write equations 
to cover all the detail of any explosive event. It is certain that no two thun- 
dei-stf)rms liave been exactly alike, and yet the constructs of physics are 
applied in comprehending thunder and lightning, without any demand that 
the detail of the landscape bo covered by the same scientific constructs. 
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The attitudes of people on a controversial social issue; have been appraised 
by allocating each person to a point on a linear continuum ius regards his 
favorable or his unfavorable affect toward the psychological object. Some 
social scientists have objected because two individuals may have the .«ame 
attitude score toward, say, pacifism, and yet be totally dilTereiit m their 
backgrounds and in the causes of their similar social views. If sui'h critics 
were consistent, they would object also to the statement that two mtm have 
identical incomes, for one of them earns while the other one .steals. 'I'hey 
should also object to the statement that two men are of the .same height. 
The comparison should be held invalid because one of tlie mrui i.s fiH and 
the other is thin. This is again the resistance against invailing with the 
g pnnrniWmg and Simplifying constiucts of science n rcahii which i.s habitual¬ 
ly comprehended only in terms of innumerable and indivithuilizcd detail. 
Every scientific construct limits itself to .specified vuriahli'.s without any 
pretense of covering those aspects of a cla.^ of phenoinriia about wliicli it 
has said nothing. As regards this characteristic! of science, (here, is no differ¬ 
ence between the scientific study of phjreical events and the .scieiitilic study 
of biological and psychological events. What is not generally und(!rstood, 
even by many scientists, is that no scientific law is ever intended to repre¬ 
sent any event pictorially. The law is only an nb.struction from the (‘\peii- 
mental situation. No experiment is ever completely repealr>d. 

There is an unlimited number of ways in which nature can lie conijiie- 
hended in terms of fundamental seientifie. emieepts. One of tin* .siinjilest 
ways in which a class of phenomena can be comprehended in ti’i’ins of a 
limited number of concepts is probably that in which a linear at Irilmf e of an 
event is expressed as a linear function of primary eause,s. Even when the 
relations are preferably non-linear and mathematically involved, it, i.s fre¬ 
quently possible to use the simple linear forms as first apiiroxinialionH. A 
well-known example of this type of relation is that in which the chroma of 
a spectral color is expressed as a linear function of two arbitrarily clio.spn 
primaries. If two spectral colors are chosen arbitrarily for use aa primaries, 
it is possible to express any intermediate color as a linear function of the 
two arbitrarily chosen primaries. The coefficients of the two terms of this 
linear fimction represent the angular sizes of the two sectors into which a 
color rotator is divided. When the rotator is spun, the iuterniedinti* color 
is seen. But here, as elsewhere in science, although the chroma of the re¬ 
sulting color is expressed in terms of the linear fuiuition of the arbitral^ 
primaries, it does not follow that the saturation and the. gray-value,s are 
expressed by the same law. There is still debate about which I'olors are to 
be considered primary. This question can be settled only by discoviiriiig 
that a certain set of primaries gives the most parsimonious compri'hen.sion 
of some phase of color vision. A parallel in the delineation of human traits 
is their description, in first approximation, as linear functions of a limited 
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number of r(?fercn{;e traits. The final choice of a set of primary reference 
traits or facultic.s mu.st be made in terms of the discovery that a particular 
set of reference traits renders most parsimonious our comprehension of a 
great variety of human traits. 

The purpose of factor analysis 

A fa(!tor problem starts with the hope or conviction that a certain do¬ 
main i.s not .so chaotif^ a,s it looks. The range of phenomena that is repre¬ 
sented in any factor analy.si.s will be referred to as its domain. If a particular 
investigation is limited to mcsvsurements in visual perception, it is likely 
that auditory cfTecfcs will be outside of its domain. The factorial methods 
were developed primarily for the purpose of identifying the principal di- 
men.sions or categories of mentality; but the methods are general, so that 
they have been found useful for other psychological problems and in other 
sciences as well. Factor analysis can be regoi-ded as a general scientific 
method. Hituie the methods were developed especially for the solution of 
psycliological problems and since the new methods have been used so far 
mainly on psychohjgical problems, these will be lused for most of the ex¬ 
amples in this text. .Some of the principles can be illustrated to best advan¬ 
tage in terms of simple meelianiiuil or geometrical examples; and these will 
be used occfusionally, especially wlien it is dasirerl to illustrate a logical prin¬ 
ciple witlmut involving the distractions of controversial or nebulous sub¬ 
ject matter, 

The factorial methods were developed for the study of individual differ¬ 
ences among pe<jpl<!, but the individual differences may be regarded as an 
avenue of api)roaeh to the study of the processes which underlie these dif- 
fcrcn(:e.s. If a proco.ss is invariant in all its characteristics in an experimental 
popiilation of indivi<luala, then there exist no individual differences as re¬ 
gards .such a process, and it cannot be investigated by factorial means. 

Thu.s, if we .sclcc;t an experimental population of individuals who are all 
eqtially good or ecpially bad in some form of visual perception, then we can¬ 
not expect to identify or differentiate such processes by factorial methods. 
It is only to the extent that the individuals of an experimental population 
exhibit individual differences in a process and its effects that these effects 
can become accessible to investigation by factorial methods. 

When a particular domain is to be investigated by means of individual 
differcncp.s, one can proceed in one of two ways. One can invent a hypoth- 
csi.s regarding the proces.sc.s that underlie the individual differences, and one 
can then set up a factorial experiment, or a more direct laboratory experi¬ 
ment, to te.st tlic hypotho.sia. If no promising hypothesis is available, one 
can represent the domain as adequately as possible in terms of a set of 
measurements or numerical indices and proceed with a factorial experiment. 
The analysis might reveal an underlying order which would be of great as- 
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sistauce in formulating the scientific concepts covering the purticulur do¬ 
main. In the first case we start with a hypothesi.s that detcnninc.s the na¬ 
ture of the measurements that enter into the fai’tfjriul suialysis. In the sec¬ 
ond case we start with no hypothesis, but we proceed, instead, with a .set of 
measurements or indices that cover the domain, hoping to dlMcover in the 
factorial analysis the nature of the underlying order. It is thi-s latter uppli- 
cation of the factorial methods that is sometimes referrwl to w an attempt 
to lift ourselves by our own boot straps, becau.se the inulerlyiiig order in u 
domain can be discovered without first postulating it in the fttrm of a 
hypothesis. This is probably the characteristie of factor unaly.‘*i.s that gives 
it some interest as a general scientific method. 

Factor analysis is not restricted by assumptions regarding the natiare. of 
the factors, whether they be physiological or social, elemental or cojnplex, 
correlated or uncorrelated. For example, some of the factors may turn out 
to be defined by endocrinological effects. Others may l>e delined in bio¬ 
chemical or biophysical parameters of the body fluids or of the cetdral nerv¬ 
ous system. Other factors may he deflned by neurological or vascular rela¬ 
tions in some anatomical locus; still other factors may invtdvi* parameters 
in the dynamics of the autonomic nervous system; still others may be de¬ 
fined in terms of experience and schooling. Factor analysis asHuinc'.s tliat a 
variety of phenomena within a domain are related and that they arc de¬ 
termined, at least in part, by a relatively small number of fuiictioiml unities 
or factors. The factors may bo called by different names, such as "causes," 
“faculties," “parameters," "functional unitias," "abilities," or "imleiMMul- 
ent measurements." The name for a factor depends on tlm context, (»n erne's 
philosophical preferences and manner of speech, and on how mucdi one al¬ 
ready knows about the domain to be investigated. The factors in iwycho- 
logioal investigations are not ordinarily to be thought of as elemental tilings 
which are present or absent, like heads or tails in the tossing of coins. 

The exploratory nature of factor analysis is often not understood, Fac¬ 
tor analysis has its principal usefulness at the border line of science. It is 
naturally superseded by rational fomulations in terms of the .science in¬ 
volved. Factor analysis is useful, especially in those domains wlns'e biusic 
and fruitful concepts are essentially lacking and where crucial exp(*rimeut8 
have been difficult to conceive. The new methods have a humble role. They 
enable to make only the crudest first map of a now domain. But if we 
have scientific intuition and sufficient ingenuity, the rough far;birial map 
of a new domain will enable us to proceed beyond the exploratory factorial 
stage to the more direct forms of pijychological experimental ion in the 
laboratory. 

In a domam where fundamental and fruitful concepts are alrea<Iy well 
formulated and tested, it would be absurd to use the factorial methods ex¬ 
cept for didactic purposes to illustrate factorial logic. In such situations 
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there are available more direct methods of investigating rival hypotheses. 
In the relatively young sciences and in the new domains of the older scien¬ 
ces, the factorial experiments will be useful. It seems quite likely that the 
new methods will be applied with profit in the field of meteorology, but it 
is not likely that they will ever be used in classical mechanics. 

In factorial investigations of mentality we proceed on the assumption 
that mind is structured somehow, that mind is not a patternless mosaic of 
an infinite number f)f elements without functional groupings. The extreme, 
opposite view wouhl be to hold that mind has no structure at all. In the 
inkrprelation of mind we assurne Dial mental phenomena can be identified in 
term of dislingutHhahle functions, which do not all participate equally in every¬ 
thing that mind does. It is these functional unities that we are looking for 
with the aid of factorial methods. It is our scientific faith that such dis¬ 
tinguishable mental functions can be identified and that they will be veri¬ 
fied in different types of experimental study. No assumption is made about 
the nature of these functions, whether they are native 'or acquhed or wheth¬ 


er they have a cortitial locus. 

In order to illustrate the method, let us consider a set of gymnastic stunts 
that might be given to a group of several hundred boys of comparable age. 

A ftu!t((r analysis starts with a table of intercorrelations of the variables. 

If thore wore twenty different stunts, we should have a squai’e 20X20 table 
showing tluj correlation of every performance with every other performance. 
Our question now is to determine whether these relations can be compre¬ 
hended in terms of some underlying order, which is simpler than the whole 
table of several hundred experimentally determined coefficients of correla¬ 
tion. I^t us 3Vxppo.se that some of the stunts require principally strength of 
the right arm, that others require principally a good sense of balance, that 
still othei^ require speed of bodily movement. Several tests that require 
good sense of balance might not require arm strength, while those which 
require a strong arm might require very little bodily balance. We inight then 
find that the correlations can be comprehended in terms of a small number 
of functional unities, such as sense of balance, arm strength, or speed of 
bodily movement. Each of the gymnastic tests might require one or several 
of the.se functional unities; but it is not likely that t®t wiU reqviire 
every one of the functional unities that are represented by the whole set of 
gymnastic tc-sts. A factorial analysis would reveal these fiinctional unities, 
and we would say that each of them is a prima^ factor m the battery of 
tests. Now, if we should take any one of these functional unities, such as 
sense of balancic, and represent it in a new set of twenty tests of great variety 
which all required bodily balance, we might find that there are really severa 
primary factors involved in this domain. For example, there migh - 
ceivably be a separate balancing factor for each of the semicircular canals, 
or therLight be some other breakdown of the balancing factors that would 
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be revealed in on extensive study of balandiiK lusts.* A iiuw m-I of inore 
refined primaiy factors might be found within the (ioiiutin **f 1 h iflily baluiioe. 
This process might continue with the fiirtoriul in\i‘.stigjitiofi uf luoro and 
more restricted domains, ns long as the ftinctifinal unities rtmtiiun'd to be 
difiicult to conceive in direct cxporiinentiilion. Ev'c’iituiilly, tin; fiictorial 
metliods, which are essentially exploratory, would yield tu the rebiriiiula- 
tion of a problem in terms of the fundamental ratii>n!d con.-ifrucls fd the 
science involved. It is not unlikely that ftu'torial antilv-scs will injint the 
way in the work of inventing significant and finulatneiit ul .scieiit itic t'oncttpl.s. 

Let us consider, next, an cxnmplo in the sensory and jttU'citptual fiidtls. 
Let us stai't with a set of twenty per<‘<;ptual tests iuvttlving si’veral of the 
modalities. Some of the te.sta might require visual atniityj otlitTS woidtl re¬ 
quire keen discrimination of rhythm; still others might rtaiuire S(»(Hnl of ik?i-- 
ception. Each of the perceptual te.sts might involve one or more ttf these 
functional unities; but few would require all these funetion.s. Soim* of the 
tests, for example, might not depend on visual acuity. In (his simjdc^ case 
we should not be sui’priscd to find factorially the jiiiniary funct ional unities 
that are obvious at the start. 

If we turn to the more central functions that are involved in the. intelleo 
tual and temperamental differenetjs among prtople, it .seems reitstitiable to 
suppose that here also we may expect to Ihul fimetional unifie.s that will 
some day be as obvious as the .sensory and iHiretsptiial nnilie,s are olndons 
to us now. 

Our work in the factorial study of tire human mind re.Hls on the {lasuntp- 
tion that mind represents a dynamical sy.stem wliieh can eventually be 
understood in terms of a finite number of parameters. We have !U«>nnu'.d, 
further, that all these parameters, or groups of paraimdms, urti ntd in¬ 
volved in the individual differences of every kind of mental ta-^^k. Jimt as 
we take it for granted that the individual differcm'c.s in visual acuity are 
not involved in pitch discrimination, so we assume that in intellectual task.H 
some mental or cortical functions are not involved in eviuy tu.'ik. 'Phis is 
the principle of “simple structure” or "siinplo cimfignratnm" in the under¬ 
lying order for any given set of attribute.s. 

Observation and educational experience lend i)lan.sibiliLy to tin; concep¬ 
tion that the mental abilities are determined by a great multi])lieity of 
causes or determiners and that these cli;tcrnnni!r.s are mort) or less .structured 
or linked in groups. This multiplicity of determiners can In? thought of as 
afield of elements in which all are not equally closely linked, Some elemenls 
maybe quite independent in tlicir actions, wliile olliers inay lie ratber closely 
^ociated. The factors are probably functional groupings, and it w«)uld 
be a distortion to assume that they must bo elemental. Wo know prei-ions 

* Several such factors might appear in the place of specific variance arul iiiiinU*riiretcd 
oommon-factor variance in the earlier studies. 



THE FACTOR PROBLEM 


59 


little about the determiners of human talent and temperament, and we 
should not impose upon our thinking an unnecessarily rigid causal frame. 

If we grant that men arc not all equal in intellectual endowment and in 
temperament and if wo have the faith that this domain can be investigated 
as science, then we mu.st make the plausible and inevitable assumption that 
individual differences among men can be conceived in terms of a finite num¬ 
ber of traits, parameters, or factors. Some of the factors may be found to 
be anatomically determined; others will be physiological; while others will be 
defined, at first, in experiential, educational, and social terms. As scientists, 
we must believe that a set of categories can be found for the understanding 
of mentality, which have, by their simplicity, a prior claim on our concep¬ 
tual formulations. 

Factor analysis and empirical prediction 

Factor analysis involves a number of well-known statistical procedui-es, 
and it is only natural for the student to begin his study of factor theoi-y with 
a statistical point of view. In some respects this point of view is legitimate 
and usoful, but there are some fundamental differences between the objec- 
tive.s of factor analysis and the customary objectives in statistical work 
that might as well be made explicit at the start. Some of the controversial 
questions in factor theory have their source in misunderstandings about the 
objective-s for which factor theory was developed. 

Many statisthial problems take a form in which a certain number of in¬ 
dices are available for each member of a statistical population, and it is de¬ 
sired to predict some new index in terms of the known or given indices for 
cadi memb(!r of the population. A familiar example in psychological work 
is the prediction of student scholarship in terms of indices that are available 
at tlie time of college entrance. Prediction problems of this type are re¬ 
solved by writing a regression equation, in which the dependent variable 
which is to bo predicted is expressed as a linear function of the independent 
variable.s. The weight given to each independent variable is called ite re¬ 
gression coefficient,” and the weights are so determined as to minimize the 
sum of the squares of the residual errors. The multiple correlation coeffi¬ 
cient is the correlation between the predicted values of the dependent vari¬ 
able and the actually observed values. When the residual errors are sniall, 
the multiple correlation is high. Factor analysis differs from these statisti¬ 
cal problems in that there is no distinction between independent and 
dependent variables. In factor analysis one does not select some one vari¬ 
able which in to be predicted or determined by the other variables. All the 
variable.s in fiwitor analysis arc treated alike in this sense. Whenever the 
inve.stigntor pivots his attention on one of the given variables which cen¬ 
tral in importance and which is to bo predicted by a set of independent 
variables, he is not talking about a factor problem. He is then talking 
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about a customary statistical problem, invrrlvinK a I'quaficui and 

multiple correlation. If he looks upon the whole aet of vuriahJof! as repre- 
porting a domain that is to be explored and if hi.s object is to discover wheth¬ 
er there is some underlying order among these variables, then h(< is talking 
about a factor problem. Of course, it is po.s.sibln to treat tlin same .set of 
data successively by the two pointe of view. In the first case we me cen- 
cemed about the prediction of one of the variables fnati fire otiters, while 
in the second case we try to discover some underlying ttrder in (he whole 
system of traits. 

It might be noted, in passing, that the distiitction tHttwr^cn indeiHuulent 
and dependent variables is not intrinsic in the phenomena th(‘tn!^< lv(v<. The 
differentiation between independent and de.pcndr!nt variables refUii'Is only 
the attitude or purpose of the investigator. What i.s an indt^pendent vari¬ 
able for one investigator can be a dependent one for anothfsr invesligator 
working with the same data. Sometimes an author re veals hi.s bias un¬ 
wittingly in the way he plots diagrams. What he pl<»l« as a luvw* line is 
likely to be his independent variable. What he. plots f»« r>r<lina(e,s i.s likely 
to be his dependent variable. In this way we may .show (liat a depression 
is caused by unemployment or that uneniployinent is can.^ed by a de¬ 
pression. 


In the factor problem as well as in tlie statistical pritdiction problem, one 
is concerned about residuals and how to minimizej them. Tliis is practically 
universal in problems that involve observational data. In (he Htatlstic-al 
prediction problem, one’s attention is centered on tl»* one variable which 


IS to be predicted and on how to minimize the resiilual erroi-s in (hat. pre¬ 
diction. In the factor problem, one is concerned about how U) account for 
the observed correlations among all the variables in terms of the smalUiat 
number of factors and with the smallest possible residual errors. Here we 
have the practical problem that, as we postulate more and more factors to 
account for the observed correlations, the residuals got smaller und smaller. 
Hence, every factor problem must deal with the practical <pi«<tion of de¬ 
termining when the addition of a new factor causes only a negligible reduc¬ 
tion in the residuals. The mathematical theory of this problem bos not yet 
bem adequately solved, but there have been developed practical methods 
of dealing with it. There seems to be some question os tt) whether tho na¬ 
ture of the problem is such that a rigorous solution exiata; but that is for 
later discussion. 

There are problems in which the distinction betwwm muUiiile correla¬ 
tion and factor theory is not sharply drawn, and we shall dcHcrilai one ex¬ 
ample here. If a set of twenty independent variables is to lie used for the 
prediction of a certain criterion, one's first impulse might bo to writ-e a ro- 
^^on equafaon of twenty terms in which each of tho twenty given vari- 
b es IS weighted so as to give the best possible prediction of the dependent 



THE FACTOR PROBLEM 


61 


variable. In many situations such a solution would give regression coeffi¬ 
cients which are so grossly in error that their absurdity can be seen by in¬ 
spection. This result happens if the supposedly independent variables are 
not linearly independent. If the intercorrelations of those twenty variables 
can be accounted for in terms of, say, six factors, then we should be justi¬ 
fied in using only six terms in the regression equation. Any additional 
terms in that equation would be likely to give absurd results, since they 
would imply that wc rely on more factora than are really present in the sup¬ 
posedly indepeudont variables. The intercorrelations of the twenty vari¬ 
ables might then be analyzed factorially in order to determine six groups, 
each of which would give an average or composite. These sbe composites 
could then be weighted in a regres.sion equation of six terms for as many in¬ 
dependent variables. Such a problem is, however, only a prediction prob¬ 
lem, and the prediction might be accomplished as well by different group¬ 
ings' of the twenty given variables or indices. In the more fundamental 
factorial problem the object is to discover whether the variables can be 
made to exhibit some underlying order that may throw light on the proc- 
e.SHes that produce the individual differences shown in all the variables. 

In statistical prediction, the independent variables are given, and the 
problem is to predict some one dependent variable. The weights that are 
given to the independent variables do not ordinarily have any direct ph^i- 
cal interpretation, because they depend on the number of given variables, 
their disponsions, and their correlations among themselves and with the 
variable that is to be predicted. The weights or regression coefficients 
arc ordinarily treated merely as numerical coefficients which happen to 
maximize the multiple correlation. Their use is justified, not because of the 
meaning that can be attributed to their numerical values, but rather to the 
mere fact that a prediction can be made with the minimum residual. 

In factor analysis, all the given vaiiables are treated m co-orffinate ^ 
regards independence or dependence. The object of a factor problem is 
account for the testa, or their intercorrelations, in terms of a small 
of derived variables, the smallest possible number that is ^ 

acceptable residual errors. The weights that are given to these derived 
Sics are given more direct physical Merpretation than js ^^e 
case with regression coefficients. The derived variables are of scientific in¬ 
terest only in so far as they represent processes or parameters that involve 
ttm fundaLntal concepts of the science involved, 

prediction problem demanda merely that a good prediction shall be made, 
the factorial problem demands that there shall be a 
tion of the small number of derived variables m terms of which the whole 
Bftt of iriven variables can be comprehended. , . .. i, 

Since it is the derived variables, or factors, that are 
factorial analysis, one might regard them as dependent variables. This 
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terpretation would agree with the usual nipauitig nf t hu torms, '‘irKlf pciidpiit" 
and “dependent," if the factors had previously bitMi isolatf-d and if wc had 
started out to determine which tests constitute tho l«--st af»i)raisal of a given 
factor. Such a problem would be similar to the fatnihar piohleiu in test (!on- 
struction when the object is to determine tht* relative validi(ie.s of several 
tests for a given criterion. In the exploratory tyiw of iirohleiii for which the 
factorial methods were developed, tlie object is to disertver the underlying 
order in a system of variables and to identify their nature. In this n.‘<e of the 
factorial methods there is no distinction hetweeu iudet>i'tidetit and fieix-nd- 
ent variables. 


Psychological postulates and definitions 

The factorial methods have been developed primarily for flic purist.'-cs of 
analyzing the relations of human traits. Tiiesn arc defined a.s follovv.s; 

Definition 1. A trait is any atlribute of an indiiridiinl. 

The factorial methods are applicable also in the aiialy.'iiH of :ittribute.s of 
inanimate members of a group. The menilxus of u .slufisth-ul ]si)Milatioii 
may be momenta in time or regions in space <ir any other entifie,«, eaeli of 
which has a set of attributes. This generalization will not Ih* umiie ex¬ 
plicitly, but it is implied in the following idiaptciw. fSiiiec the methods have 
been developed primarily with psyihological categorie.s in minrl, these will 
be explicitly discussed, oven though the saine methods are ar*J>licahlt> lo 
problems which involve the attributes of inauliiiule memlsus of ii sluf isl icul 


group. 

It is useful to distinguish between tho.sc. Irail.s which an* diwrijitivi* rtf 
the individual as he appears to others and tho.se. traits which are exesniililicd 
primarily in the things that he can do. This disliia-tion Is involved iu the. 
definition of “ability." 


Definition 2. An ability is a trait which is defined Uy whnt nn individml 
can do. 

This deteition implies that there are as many abilities a.s Ihero arc enumer¬ 
able things that individuals can do. Each ability i.s thercfmx* »)bjcctivcly 
defined in terms of a specified task and of aspccificd method of apprai.sing it. 
Defimtion 3. The tosh, together with the method of appramny it, which 
defines an ability, is called a test. 


Definition 4. The numerical evaluation of a lest performance is called a 
score. 

It 18 implied in these definitions that an index of ability is covariant with 
the score m the test which defines tlie ability and that a true index of ability 
IS covanant with the true score in the test. 

It is desirable to develop the factorial motliods in such a manner tliat they 

1 ^?® normality of ability in any partimilar 

penmental population. In the present theoretical development of the fuelorM 
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jnethods it will not be assumed that any of the distributions of ability are nor- 

The application of the factorial methoda in science rests on a fundamental 
postulate. 

Postulate. The standard scores of all individuals in an unlimited number of 
abilities can be expressed, in first approximation, as linear functions of 
their staiidai'd scores in a limited number of abilities. 

The correlation between the true scores in two tests will be referred to as 
the correlation between the two abilities which are defined by the tests. In 
statistical work it is cuatomaiy to refer to two variables as “independent” 
when their correlation is zero. The term independence will be used with three 
different meanings. They will be designated by appropriate adjectives un- 
le.ss the context makes the designation unnecessary. 

Definition 5. A set of n abilities are linearly independent if the rank of 
the matrix of their true intercorrelaiions is n. 

Definition 6. Two abilities are statistically independent in a population 
if their correlation is zero in that population. 

Definition 7. Two observations are experimentally independent if they 
are experimentally distinct, so that one is not derived from the other ^ a 
constraint either of the experimental situaiion or of the compviations. 

In one sense, no two observations can ever be experimentally independ¬ 
ent. The term can be used only with reference to the state of knowledge at 

the time that the observations are made. 

It is clarifying to interpret geometrically the relations of abilities. In 
such a context, two abilities that are uncorrelated in a population will be 
called orthogonal in that population. Two abilities that are correlated in a 
population will be called oblique in that population. 

There is special interest in the limited number of abilities in terms of 
which all other abilities can be defined, since these are landmarks in terms 
of which all abilities can be comprehended. 

The reduction of raw scores to standard scores 

A factor analysis starts, ordinarily, with a table of mtercorrelations be¬ 
tween the variables that are to be analyzed. These correlations ^e com¬ 
puted from the individual test scores for the experimental population. It is 
of interest, therefore, to consider the reduction of the raw 
scores, .such as standard scores, and the effect of such reductions on the cor¬ 
relation coefficients and on the resulting factorial structure. 

It will be useful to recall that the coefficient of correlation between two 
variables * and y is unaffected if an arbitrai-y co^tant is added *0 the ® s 
and if some arbitrary constant is added to the y s. 

ficient of correlation between the two vanables is unaffected if the ® s are 
mXlied by some arbitrary multiplier and if the y’s are similarly subjected 
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to some arbitrary stretching factor. The.se propertio.s of the; correlation coof 
ficient can be summarized in the statement that the corrt'lafinn coeffie^ient 
for two variables a: and 2 / is the same as the correlation btdween any linear 
functions of x and y. Stated in symbols, we have 


( 1 ) 




where a, b, c, d, are arbitrary constants. 

Two ways of reducing the given raw scores to stamhml foini will Ih* con 
sidered here They give numerically different values for the .stanthird .seres 
and different mtercorrelations. * ” 

C<m l. assumiy thai the dislrihvUon of abiliiy is not ncteumrihj (Jnnman- 
Let the given distribution of raw scores be represented by the .skewed fre 
quency curve at A in Fwc i, with mean at m, which i.s the mea : 
raw scores in t^tLet denote the raw score of individuamn l^t 
he frequency distnbution A of the raw scores Xjt will be subjected to two 
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shape, ao that the new mean will be at the orSTand f2 a 
tor, by which the distribution B is changed to the form , "t i 

sn = {Xji ~ VI,) , 

“cSriAfThe t’u; .stn-tehing 

has unit standard deviation The shape o/the^d-Tr ^ 
same as the shape of the distribution^ni distribution C is exactly the 
The correlation of any variable with tht> ^ degree of skewness, 
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ture of this reductiortTZdard “«ant fca- 

unal.red and the correlaSS^^ 
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tion coefficients between the Var ab^a^ 
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cording to the abihty representedrS® f order ac- 
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iadividual is detei’mined from his raw score, the corresponding normalized 
standard score can be found directly and without further computation from 
the Kelley-Wood tables of the probability curve or from similar tables. This 
reduction to normalized standard scores gives a distribution that is normal 
with mean at the origin and with unit standard deviation. The only func¬ 
tion served by the raw scores in this case is to arrange the individuals in 
rank order, and no attention is then given to the actual numerical values of 
the scores beyond their rank order. 

These two ways of reducing the raw scores to standard form raise the 
question as to which of the two ways should be adopted. Psychological con¬ 
siderations enter into this choice, but fortunately the factorial results do not 
seem to be seriously affected in those problems which are otherwise determi¬ 
nate. In dealing with the raw scores on psychological testa, it must be rec¬ 
ognized that the scoring methods are, on the whole, quite arbitrary. So 
many points are allowed for this, and so many points ai'e deducted for 
something else. The resulting raw scores in tests are as arbitrary as the 
scoring formulae adopted by the intuitions of the investigator. The editorial 
composition of a paper-and-pencil test also has an effect on this problem. If 
a large number of relatively easy tasks is included, the raw scores will rise. 
The dispersion of the scores and the shape of the distribution are markedly 
affected by the more or less arbitrary time limits that are adopted for a 
test. If the distribution is positively skewed, it can ordinarily be made to 
approach the normal shape by merely increasing the time limit for the test. 
It takes very little experience in test construction to realize that the di-s- 
tribution of raw scores has relatively little fundamental significance, and 
consequently it seems proper to regard them as essentially not much more 
than a set of indices that place the subjects in rank order according to their 
ability to do the kind of task that is involved in the test. If the intuitions 
of the psychologist in assembling a new test and in adopting a scoring f(jr- 
mula ore not too seriously in error, he will obtain an approximate rank order 
of his subjects that will remain essentially unaltered with reasonable .shifts 
in editorial composition and in some changes of scoring formulae, even 
though the raw scores and the shape of their distribution might be .subject 
to considerable alteration by such changes. 

If the factorial methods were seriously dependent on the investigator's 
luck in hitting some sort of “right” scoring formula and time limit for each 
tMt, the new methods would not be able to produce meaningful ro.sulfH. 
The factorial methods are sufficiently powerful that one can take consider¬ 
able liberties with the raw scores without seriously affecting the rc.sulta. If 
we t^e a factor analyris in which several fundamental and meaningful fac¬ 
tors have been clearly identified, it would be instructive to subject the fac- 
tor methods to a severe test by radical changes in the original raw scores 
and then make a new factor analysis with the altered scores. We might 
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change the sforcs in nini test by writing their recipmeaLs instead; the scores 
in another test might l)o altered by writing their square roots; the scores for 
another test might be altered by writing their logarithms; still another test 
might be alttu'e.d by using the squares of the original scores instead of the 
scores tlamrselves; and so on with a new inonotonie function for each lest. 
The rank orders of the stilqects in a test would bo cither the same or com¬ 
pletely 1 ‘e.versed. Wo inighf. use ease 1 in reducing the scores to standard 
form so as to rtil itin for thti correlatitins all the distorted distribution shapes. 
The correlation coenicit-nts to be analyzed would then be markedly different 
from thos(! used in the original analy.sis, Init it .seems quite likely that the 
same ba.sic facf<»rs would b(‘. identifitid. This demonstration has not been 
made,* bnt it prohaldy would bo sticcessful in showing the power of the 
factorial method.s in isolating the underlying order among the test variables 
and the basic, f.actors that dederinine the individual differences. 

• Since this cliuiiit-r wuh wrillni, llift (IciininHtrntum hua been made, and it la doacribed 
in rhap. xv. 



CHAPTER II 

FUNDAMENTAL EQUATIONS 


Reference abilities 

In a multiple correlation problem one writes a regression equation to ex¬ 
press a dependent variable as a linear combination of a set of independent 
variables. Applied to psychological tests, the regression equation is an at¬ 
tempt to predict a criterion—^the dependent variable—as a linear combina¬ 
tion of a set of tests—the independent variables. The observation equation 
which is the starting-point for multiple-factor theory is analogous to the 
familiar regression equation in certain respects. The score in a test is ex¬ 
pressed as a linear function of the scorra in a set of postulated reference abil¬ 
ities. Here the standard score sji of individual i in test j corresponds to the 
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dependent variable which is to be accounted for; but in the factor problem 
all the individual test scores are dependent vaiiables, in this sense, that are 
to be accounted for. 

If an experimental population of JV individuals has been given a set of 
n tests, the resulting tabulation of .scores will be an nXN-soovc matrix iS', 
whose elements are the standard scores sa, where the subscript j rofors til 
the test and i refers to the individual (see Figure 1). If the teat battery liiw? a 
airly large number of tests, n, and if these cover a fairly restricted range, 
one might attempt to account for the scores syj in terms of a smaller numbor 

follo^ng^qurti*^^^^^ “ represented in the 

+ C/Blai H--I- CyjOlef , 

individual i in test j, the ic’s are standard 
scores of individual i in each of the uncorrelated reference abilities, and the 
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c’s are tlic weights assigned tn the standard scores in the reference abilities 
for the determination of the observed standard score s,(. The equation is 
written to represent q terms in the right-hand member, and it is hoped that 
this number of reference aliilities will be relatively small compared with the 
number of tests, n, in the whole battery. 

The p,sychological interpretation of equation (1) is that a subject's per¬ 
formance, n/i, on a twt is determined in part by the abilities that are called 
for by the te.st and in part by the degrce.s to which the subject possesses 
these abilities. It .shemid I)c nntcHl that the x’s in equation (1) contain the 
subscript i but n(»t j. Hence tin; r’.s arc descriptive of the individuals but not 
of the tests. The c’s in the .same equation have subscript j but not i. Hence 
the c’s are descrijjtive of the tests but not of the individual subjects. The 
first term repre.st*nts the contribution of the first reference ability to the 
score, the second term rcpr(>.sents the contribution of the second reference 
ability, and so on, for q rf‘ft!r(!n<!<! ubiliti{‘.s. If the first reference ability is in¬ 
volved in the test j, then the coefficient c,i will be large and positive. If 
the individual i pct.s.-io.sses this reference ability to a marked extent, then his 
standard .scor(! in that aliility, ari,-, will be large and positive. The prodtict 
will bo an upi)r(!ciabl(,! (Hiutribution toward a good score in the test. If the 
second reference, ahilily is not involved in tost then the coefficient cjt will 
be zero; and if the individual i has this .second reference ability to a marked 
degree, his .standard score xs,- will be large and positive, but it will not con¬ 
tribute toward the sj-ort! in the t(«t because the test does not involve this 
second ability. For this individual subject and test, the second term van¬ 
ishes. Similar intttrpretation can l>c made for high and low test coefficients 
and for high and low standard scores in the reference abilities. 

If the elandard scores of N indiindtials in n abilities are expressed as linear 
fundions of their scores in r Ivicarly independent abilities, where r<n, then 
the r abilities will he called reference abilities. 

It will be shown that if a battery of t&sts can be described with reference to 
r orthogonal abilities, there exists an infinite number of sets of r orthogonal 
abilities in ternus of which the description can be made with equal accuracy. 
An arbitraiy set of r orthogonal abilities may be chosen for purposes of de¬ 
scription. Thcs(! are tlm statistically independent or orthogonal reference 
abilities. If a battery (»f tests can be described in tenns of r orthogonal refer¬ 
ence abilities, the tc.«ts <;an also he dcacribcd by a set of r oblique reference 
abilities. It is not ncccasary that a reference ability bo represented by a 
test in which it is involved exclusively. While each of the tests used in ex¬ 
perimental work defines an ability, it may happen that the reference abil¬ 
ities in terms of whiidi te.sts and individuals are dascribed are not represented 
by actual tc.sts but by linear combinations of several tests. A linear com¬ 
bination of tests may bo thought of as a composite test. 

It should be noted that, even if each individual can be described in terms 
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of a limited number of independent reference abilities, it is still possible for 
every person to be different from every other person in the world. Each 
person might be described in terms of his standard scores in a limited num¬ 
ber of independent abilities. The number of permutations of these scores 
would probably be sufficient to guarantee the retention of individualities. 

With a limited number of abilities not only does this formulation allow 
every person to be different from every other peraon, but it also allows the 
widest possible differences between several individuals who attijiin the Lsanie 
objective performance in a teat. This may be readily seen by con.sidering a 
hypothetical example. Assume that a test calls for two abilities, such iis 
ability in abstraction and ability in the manipulation of numbers. Several 
individuals try the teat and attain the same score. One of them may posse.ss 
a high degree of ability in making the abstractions involved in the test, but 
he may be slow in numerical manipulation. Another may be slow in formu¬ 
lating the abstract part of the problem, but he may make up for this de¬ 
ficiency by superior numerical speed. The objective result might be the 
same. The purpose of factor analysis is to obtain a quantitative description 
of each fundamental ability in each individual by means of tasks that re¬ 
quire these abilities in different amounts. Since every task is probably com¬ 
posite in the abilities required, it is necessary to make the appraisal of the 
abilities of individuals by analsrtical methods. This is exactly the object of 
the multiple-factor methods as applied to the problem of dc.s(!ribing the 
abilities of people. 

Factor analysis is reminiscent of faculty psychology. It is true that the 
object of factor analysis is to discover the mental faculties. But the severe 
restrictions that are imposed by the logic of factor analysis make it an ardu¬ 
ous task to isolate each new mental faculty, because it is necessary to prove 
that it is called for by the experimental observations. Factor analysis docs 
not allow that a new faculty be added as soon as a new name can be found for 
the things that people can do. In order to prove that reasoning and abstrac¬ 
tion are two different faculties, for example, it will be necessary to show that 
the tasks which call for such activities really do involve two factor's, and not 
one. 

In the psychology of the future it may be found useful to p(i.sLulalc a dif¬ 
ferent form of ideal constmet for the description of mental endowment than 
the simple one that is implied in equation (1). The ideal constructs of the 
future may involve elements with location in a space frame with siiatial, 
dynamic, and temporal constraints analogous to the ideal constructs of ge¬ 
netics. It would be unfortunate if some initial success with the analytical 
methods to be described here should lead us to commit ourselves to them 
with such force of habit as to disregard the development of entirely different 
constructs that may be indicated by improvements in measurement and by 
inconsistencies between theory and experiment. 
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The factor matrix and the population matrix 

Equation (1) can l)(^ rcpr(Wfnt(‘(l inrcctanKular form, as sliown in Figure 1. 
The faf!tor matrix F contains the elements Cj„, which are descriptive of 
tests j in terms of reference factom in. 'J'he population matrix P contains 
the cli?in(!nts whicli are descriptive- of individiuds i in terms of reference 
factors m. The cross product of !i row of F and a (silumn of P is represented 
in equation (1). If tlie factor matrix F is multiplied hy the population ma¬ 
trix /', the prod\ic1 is tin? score matrix .S' with elements us shown in equa¬ 
tion (1) ami in Figure 1. The ohservation ciiuation (1) can be written in 
tlic matrix form 


(2) N = FP . 

or in the summational notation 


( 3 ) 


9 

y 


^f 


or in tlie rcclaiiKular hirm of Figure /. it will be iissumed in our iiso of 
this (‘(Illation that the. reference abilities reiin'scnted by columns of F are 
orthoitonal. In a later chaiitcr tlie eiiuation will bo Remn’uliiscd for the cukc 
of oblique or corrclnlod n'ferciice factors. 

This observation etiuatUm is the start iiiR-point for the development of 
factorial theory. It should be noted that all the c’.s and all the .t’s are 
unknown and that we know only the individual .score.s sji in each tost at 
the start of a factorial analysis. 

Interpretation of the test coefficients 
The entries i'j„ of the factor matrix F dascribo tlio tests j in terms of the 
factors in, and they are called tlie lent ronffu'ieritn or factor loadings. Their 
interpn'tatiori can lie found in fiirin.s of the variance of the te.sts. 

Since .'f|i and j-mi are standard scores, their sums for the experimental 
population are idciiticidly zero. Then, by (.'!), 
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The standard deviations of and of Xmi are both unity by definition. 
Hence 

( 6 ) = 

and 

(7) ^ ■ 

The square of the standard score, sji, is 

Q Q Q 

( 8 ) ^ ^ f "I" ^ 

m—1 ilf—1 m=l 

where m and M are subscripts denoting the reference factors and where 
m 7^ M. Summing the squares of the standard scores over the experimen¬ 
tal population and dividing by N, we have 

(9) <r* = = nS ^ • 

i*="l i*"! 

Rearranging the summations, we have 

(10) V? ~ CjmCjaif jT Cy^ ^ a"®,,- = 1 . 

m=lJlf=l i=l m-1 i=l 

But the correlation between each pair of orthogonal reference abilities m 
and M vanishes by definition, so that 

1 ^ 

( 11 ) ^mM " 0 , 

' »=1 

and the a:’s are standard scores by definition, so that they have unit standard 
deviation. Hence, 

<“) -1. 

»-l 


= 1 ■ 

tn»l 


so that 
(13) 
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This etjuiithin can bo .stated in the theorem that the swn of the squares of the 
test coefficients of a test for nil orlhogonnl factors is equal to unity. 

It should bo r(H*alh.'.d that this theorem concerning the test coefficients 
assumes a.sot of uncorrelated njference abilities. Each test is here represent¬ 
ed as having unit variance, since the test scores are assumed to be reduced 
to .standard form, 'riie .sejuare of each te.st coefficient, cj^i is that part of 
the total variance of test j which is at-tiibutable to the reference ability 711. 
The sum of thc.se. variances is the total unit variance of the test. 

The entries in a factor matrix arc sometimes called/odor loadings. The 
square of any cell tint ry in F, such us a;„, />;,•, c;,-, itj, represents the fractional 
part of the tottd Viiriance of a test attributable to a given factor. We have, 
then, the theorem tluit each factor loading or test coefficient cjm for orthogonal 
factors is the .square root of the variance, of lest j attrihuicible to the factor m. 

Common factors and unique factors 

The stiuare of tiuch te.si coe.llieieiit c,„, in Figure 1 tiun be interpreted as 
the fractional part, of t he. varianco of tfestj which is attributable to the refer¬ 
ence ability tm factor /«. Psyehologii'al knowledge about tests enables us 
to postulate difTcniiit kinds of factors in F. Some of the facitors represent 
abilities t hat are invt lived in t wo fjr more te,sts of a battery. These are called 
co 7 nmon factors. Another kind of fiu-tor is an ability which is involved in 
only a single! lest <if a battt'ry. The-so are <‘alle,d specific, factors. Thesje two 
typtNS of fu<<torri eiin bo illn.strale<l with a p.syehological example. In a bat¬ 
tery of tests there miglit las only one, test wh().se score depends in part on 
writing speed. l''or that battery and for that teat the ability to write fast 
woulil be it speeilie ftiebu’. IVrhirmanee in another test might depend in 
part on aeiiity of hearing, and fliat ability might not bo involved in any 
other test of the batti!ry. It would be a factor specitic to one test in the bat¬ 
tery. Other faelor.s, such as word fluency or number facility or visualizing, 
might be in two (jr more trfjsts of the battciy so that they would be common 
factors. 

The eonimon factors and the specific ftmtora are thought of os bona fide 
abilities, whose isolation and ilcseription arc of psychological interest. But, 
ill addition to the.se cognitive factors, it is well known that we must deal 
also with foi'tiiitoUH errors in te-st Heorc'.s. If wo knew the true scores in a 
particular test for a given jHipulation, the addition of fortuitous ehanco 
emirs (,o the t rue scores would increase the dispersiorm so that the true score 
variance, wmdd be some fraction of the observeil variance. This error part 
of the total variance of each test should bo represented by an error factor 
ill the factor mat rix F. Since the fortuitous variable errors in one test are, 
in general, uncorrc'late.d with the variable errors in each other test, wo must 
provide in the factor matrix F one error factor for each test of the battery. 

In Figure 2 we have represented six tests with three kinds of factors— 
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the common factors, the specific factors, and the error factors. Sampling 
errora will be discussed in a later section. In Figure 2 we have shown three 
common factors in the first three columns. The letters a, b, and c represent 
non-v a ni s h in g cell entries. The blank cells represent zero entries. The com¬ 
mon factors, I, II, III, are here shown aa if each common factor were pres¬ 
ent in each test. Later we shall consider the situation in which the common 
factors are not all present in each of the tests. The next block of the factor 
matrix of Figure 2 shows eight specific factors. Two of them occur only in 
the first teat. We have labeled them 4 and B. The third test is also shown 
with two specifics, and each of the other tests is represented with one spe¬ 
cific factor. Each test is assigned a variable error factor e,, in the third block 
of the factor matrix. 


common 
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The total variance of the first test in this fictitious example can be ex¬ 
pressed in the summation 


(14) (oil -b + 0?,) + (6f, + b\,) + = 1 , 


on the assumption that all the factors involved in the test can be divided 
into three typ^—common, specific, and error. Only the common factors 
are shared with any of the othei- tests in the battery. Each of the other 
factors 18 unique for one test. 


The tot^ variance of the test can be divided into two parts, namely, that 
part which It shares ^th other tests in a particular battery and that part 
which IS unique. We then have 
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(15) 


= ft) = communality of test j , 
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where the n’s ref(.‘r only to eoinnion fiietors and r is the number of common 
factors. The notalion hj will be u.sed to denote that part of the total vari¬ 
ance of a t(‘.st which is attributable to the common factors. 

Definition: The cotnmunality of a lest in itn cottunon-fador variance. 

The .specific factors are tho.se abilitic.s which arc involverl in only one te.st 
of a battery. Their vaiiaina* can hi! written 

(16) ’ i^pedjicity of test j, 

m**! 

where the h’s refer only to specific abilitie.s. 

Dijfinition; 77ic specificily of a test is that part of its total variance which is 
allritminhle to tOhlilics that arc uniiiuefor the test in a given battery. 
The specific factors and tin; variable, error factor are all unique for each 
particular test. Tin; fractional part of the total variance of a test which it 
does not sliar(* with aiij' olli(;r tests of the battery can be written 

t 

(17) b'in 4- !'%• ^ «/ nniquoms of test j . 

ffl«» I 

Definition: The uniqueness of a test is that part of its total variance which 
is not shared v'iih any other tests in a battery. 

It will be seen that the unviucnesH is the complement of the communalily, 
so that 

(18) A; 4 - u; « 1 . 

A factor that i.s .specilic for a fast in one battery may become a common 
factor when tin* test, is moved into another battery. Auditory acuity might 
be speeific in one hatteryj but it might become a common factor if a test 
wore mov(;d into a new buttery, where two or more tests depended on audi¬ 
tory acuity. 

All the unique factors of a lc.st may be combined into a single unique fac¬ 
tor for each test. As an (ixainph;, the uni(pie-ftu;tor entry for the first te.st 
in Figure 2 would be 

'^h'U 4' A|( + cfi ~ ?(i , 

as is also shown in eipiation (17). It will be useful to rc-write the factor 
matrix F witli two blocks instead of three. These two blocks are the common 
factors and the unifpu*. factors. This has been done in Figure 3. 

Tlie pattern of tlic non-vanishing entries in F should be noted. We have 
shown the common-factor block in F as filled, whereas the unique-factor 
block is a diagonal pattern with zeros in the side entries. This pattern fol- 
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lows from the definition according to which each of the six factors occurs in 
only one of the six tests. 

Definition; A factor matrix which represents the total unit variance of each 
test is called a complete factor matrix. 

The complete factorial matrix is denoted Fi. The factorial inatriceH of 
Figures B and 3 are complete factorial matrices. In factor tinaly.si.s it is use¬ 
ful to identify by a special name that part of the factorial matrix which rep¬ 
resents only the common factors. The common-factor block is a matrix of 
order nXr for n tests and r common factors. In Figure 3 tlii.s matrix i.s of 
order 6X3 with elements ay„. 
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Definition; A factor matrix which represents only the cmmnon-ftwfor vari¬ 
ance of each test is called a reduced factorial matrix. 

The reduced factorial matrix is denoted F. 

From this definition and equation (IS) we have the theorem that the sum 
of the squares of each row j of the reduced factorial matrix F is the communality 
h] of test j 

If we postulate a unique factor for each test, as shown in Figure 3, the 
total number of linearly independent factors in Fi i,s (n-f-r), where* r is the 
number of common factors. But this fonnulation of the pnjblein involvi*.*; 
more factors than tests, a situation that would .seem to mak<! the iirohlein 
insoluble. Before a stable solution can be expected by any imithod of tuml- 
ysis, the factor problem must be so formulated that the number of observa¬ 
tions exceeds the number of independent parameters to be determiruxl. 

The inteiconelalions 

The square table of intercorrelations of n tests is called the correlation 
matrix. Such a matrix is illustrated in Figure i. The correlation matrix is 
square, and it is symmetric because rjk^riij. When the correlation matrix is 
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written with unity in the diagonal cells, it is called a complete cmrelation 
matrix, and it is denoted Z2i. The correlation matrix can be expressed in 
terms of the matrices that have been defined in previous sections. The cor¬ 
relation between the standard scores sa and Ski, where the subscripts j and k 
both refer to tests, is 

1 ^ 

( 19 ) Tjk — ejiSki t 


since the stundard scores have unit standard deviation. If we write it in the 
form 


(19o) 
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we imply the multiplication of two score matrices, namely, s/i and s,*. 
The score matrix with elements sjt is of order nXN and it is denoted S. The 
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Figure 4 

score matrix with elements Si* is the transpose of S and is of order JVXn. 
Hence we have 

(20) Ri = ^SS', 

where the diagonal entries of Iti are unity, i.e., 

( 21 ) Tjj = “ 1 • 

By (20) and (2) wo have 

( 22 ) Ri = h (FiPKF.py 

Ri^^FiPP'Fi. 


(23) 
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The product PP' in (23) represents the cross products of rows of P. These 
can be written in the form 

N 

(24) PP' = 

i=l 

or 

(25) PP' = , 

where TmM is the correlation between the two factors or reference abilities m 


r ?? 



^#11 <*fii ... Our 


Foe for Mofrix Fr 


/• n 
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and M. These correlations are zero, except the diagonal self-correlations, 
which are unity. Hence 

(26) PP' = NI , 

where I is the identity matrix. Substituting in (23), we have 

(27) R^ = FiFi. 

This equation is fundamental in factor analysis. It can be stated as a funda¬ 
mental theorem, namely, that the ‘product of the complete factorial matrix by 
its tra'Mpose is the complete correlation matrix. 

The complete factorial matrix Pi of Figure S can be expressed as a sum 
of the two matrices shown in Figure 5. The matrix P, is of order n by (n-fr). 
where the unique factor loadings have been omitted. The matrix P„ is also 
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of order n by (n+r), where the common factor loadings have been omitted. 
If we superimpose these two matrices, we get a matrix sum of the type shown 
in Figure 3. Hence we write 

(28) Pr + F„ = Fi. 

Substituting in (27), wo have 

(29) 72, = (F, + F«)(F, + F„)' 
or 

(29a) Ri = (Fr + F„)(F; + F ^,). 

This becomes 

(30) Hi = FrF‘r + F,Fi + FuF'r + F„F„, 

in which F, and F« are both of order n by (w+r). These four separate prod¬ 
ucts in (30) are shown in rectangular notation in Figure 6. In order to sim¬ 
plify Figure 6, it has been particularized to the case of n=4 and r=2. The 
products F,F' and F„f; both vanish. Hence we have 

(31) Ri = F,F; -1- FuF'. 

The product F„Fi is shown in rectangular notation in Figure 0 , The prod¬ 
uct F„F' is a square matrix of order nXn with diagonal entries ujj. It is that 
part of the correlation matrix which shows tho contribution of the unique 
factors to the correlation matrix Ri. 

The product F^F,' in (31) is shown in rectangular notation in Figure 6. 
This product is that part of the correlational matrix Ri which is contributed 
by the common factors. It will be denoted R without subscript. Note that 
R contains the intercorrelations of the tests and that the diagonal elements 
are the communalities instead of unity as in Ri, It is of significance that 
the unique factors contribute only to the diagonal cells in the correlation matrix, 
as illustrated in Figure 6. The matrix R will be called the reduced correlation 
matrix because its diagonal elements have been depressed from unity to the 
communalities. 

The product F rF'r, where Fr is of order n by (n-!-?')( as illustrated in Fig¬ 
ure 0 , is the same as the product FF', .where F is a reduced factor matrix 
of order nXr, as shown in Figure 7. We have, therefore, the important 
equation 

(32) 


FF' = R, 
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which can be stated as the fundamental factor theorem: The product of the 
reduced factor matrix by its transpose is the reduced correlation matrix. This 
fundamental relation between F and R is shown in rectangular notation in 
Figure 7. 

The complete correlation matrix Rr has now been divided into two parts, 
namely, 22 and 22u, 

(33) 22i = 22 + 22u i 

where E„ is a diagonal matrix. This summation is shown in rectangular no¬ 
tation in Figure 8. Since each diagonal element Uf of E„ shows the unique 



/?, 


FIOTTRII 8 

variance of test j, the complete correlation matrix 22i and the reduced corre¬ 
lation matrix 22 differ only in the diagonal cells. The diagonals of 22 contain 
the communalities. 

If we regard the correlation coeflScients as the given data and the factor 
matrix F as the desired objective in a factorial analysis, we have Ti(n—1)/2 
experimentally given coefficients which must exceed the number of linearly 
independent parameters in F. It will be seen that, by limiting ourselves to 
the common factors of F and the corresponding intercorrelations, the factor 
problem becomes determinate, even though we admit the existence of unique 
variance, which is known to exist in all psychological tests. This restriction 
of the factor problem to the common factors with no attempt to account for 
the total variance of each test is one of the turning-points in finding a de¬ 
terminate solution in factor analysis as a scientific method. 
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In general, the rank of the complete correlation matrix is equal to its 
order, namely, n. Since the reduced correlation matrix B is the product 
FF', it follows that the rank of R cannot exceed the rank of F. The reduced 
factor matrix F is of order nXr, where r<n. Since the columns of F repre¬ 
sent linearly independent factors, the rank of F is equal to the num}7er of 
common factors r. Hence we have the important theorem. 2 he nutfibev of 
common factors represented in a reduced correlation matrix is e(ju(il to the rank 
of the matrix. Experimentally obtained correlation coefficients arc subject 
to sampling errors, which constitute a fortuitous element in each cocfficienti 
In the strict sense of the term, the rank of a correlation matrix for experi¬ 
mental data is always equal to its order, namely, n. The scientific problem 
is to account for as much as possible of the relations between tests by the 
smallest possible number of common factors. This leads necessarily to a 
problem of determining when the residuals are negligible for nnj' given num¬ 
ber of common factors. Tt® computational problem is made more difficult 
because the communalities in the diagonal cells of R arc unknown. Tlicse 
diagonal elements must be estimated at the start of an analj'sis in finding 
the factor matrix F for a given set of correlations in R. 

In the mathematical sense, the number of linearly independent factors 
involved in the correlations between n tests is the rank of the correlation 
matrix, irrespective of what the diagonal elements may be. In general, one 
would limit this reduction of correlations into factors by eoitsidering only 
correlation matrices whose diagonal elements do not destroy tlic Gramiun 
properties of the correlation matrix. In stating the theorem concerning the 
number of factors in a correlation matrix explicitly for the reduced (iorrn- 
lation matrix, we have in mind the scientific problem of discovering physi¬ 
cally identifiable factors as distinguished from numerical artifacts which 
might be permissible as mathematical solutions but arc not allowable as sci¬ 
entifically significant solutions in a factor problem. 

The correlation matrix for psychological tests with unity in the diagonal 
cells has, in general, a rank that is equal to its order, namely, n. Since we 
have for the complete correlation matrix the relation Ri=FiF[, we .should 
expect n linearly independent factors in Fi. But by pisychological considera¬ 
tions we expect (ra-br) = q factors in Fi, Hence the columns of Fi nr(j not 
linearly independent. It will be shown that Bi, which is of rank n and order 
n, can be factored into a factor matrix with as many factors as there arc 
tests; but such a numerical solution is not oi’diriarily of much iutornst or 
value, since it represents a condensation of (n-f-r) factons into n linoarly in¬ 
dependent columns of numbers in Fi, which rarely corre-spond to the r 
linearly independent psychological common factors of the intercorrclations. 
This numerical solution with as many factors as there are tests will be de¬ 
scribed in detail in a later section. 
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The reliability coefficient 

The correlation between two administrations of the same test or between 
two testa that are designed to bo parallel is called the reliability coeffi¬ 
cient of the test. An example is the correlation between the scores in two 
spelling tests of one hundred words each, when the two lists have been drawn 
as random samples from a longer vocabulary. If the two te.gts are truly 
parallel, they must involve the same abilities, common and specific, but the 
variable chance errors in the two tests are independent. This situation is 
represented in Figure 9. 

It is customary in psychological work to write the reliability coefficient 
in the diagonal cells of a correlation matrix. By the present analysis it is 
seen that the diagonal entries of Ri are unity, while the diagonal entries of 
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R are the communalities hj. The relation between the reliability and the 
communality of a test may be shown by considering in detail the factorial 
matrix for a test j, a parallel test j', another test k, and its parallel test k'. 
The factorial matrix for these four tests is shown in Figure 9. 

Let there be r common factors in the four tests. Let h) be the specific 
variance in test j. Since j and / aie parallel tests, it is evident that they 
must require the same common abilities and the same specific ability. 
Hence is recorded in the same column of Fi in Figure 9 for both j and /. 
For the same reason, 6* must be common to tests k and k', which are paral¬ 
lel. But the variable errors are uncorrelated by definition, even for parallel 
tests. Hence Fi shows a sepai’ate error factor for each of the four tests. 

The correlation between the tests j and j' is the reliability coefficient of 
test j, and it will be denoted ra. Since Ri= F^F^ the reliability of j can be 
found in Figure 9 as the cros.s product of the first two rows of the matrix. 
We then have 


rj: = 

7n*l 


(34) 
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and the reliability of test k is 

(35) 


By (34) we have 


(36) 

rj] =^h) + b). 

Since the total variance of j is unity, we have 

(37) 

rjj = 1 - ej. 

This equation states the theorem: The reliability of a teat ia the complemem 
of iia error variance. 

Since 

(38) 

A? = 1 - uj 

and 


(39) 

w* = &/ + e* » 

we have 


(40) 

AJ = 1 - - e? 

or 

(41) 

and hence 

h) = r»-b), 

(42) 

h^i ^ Tjj. 

This inequality states the theorem; The communality of a teat ia always small¬ 
er than the reliability except in the limiting cose where the specific factor is ab¬ 
sent, in which case the commurudUy and the relvdnliiy are equal. 

It is of interest to note that the factorial methods effect a separation be¬ 
tween the communality and the uniqueness of each test in a battery but 
that the uniqueness cannot be separated into its two principal parts— 
specificity and error—by factorial methods. In order to estimate the specific 
variance of a test or its reliability coefficient, a separate experiment must be 
made with a repetition of the test or with parallel forms of it. If the reli¬ 
ability coefficient is determined by independent experiment, the specific 



FUNDAMENTAL EQUATIONS 85 

variance can be estimated as the difference between the reliability and the 
communality. 

An object of psychological inquiry is to isolate an increasing number of 
abilities until the specific variance of each important test is reduced to a 
minimum. It is not likely that any single test will be completely described 
in terms of the factors which it has in common with those of one battery. 
In order to isolate all the abilities that are called for by a test, it will proba¬ 
bly be necessary to insert it in several test batteries in succession. The spe¬ 
cific variance of a test should be regarded as a challenge; it is that part of 
the total variance of a test which is unique in a particular battery, and hence 
its factorial composition is unknown. In order to test a hypothesis concern¬ 
ing the abilities which are involved in the specific variance of a test, the test 
should be combined with others which involve the hypothetical abilities. 
If the specific variance is reduced, the hypothesis is sustained. 

For the next few years it will probably be more interesting to isolate new 
abilities than to reduce the specificity in particular tests. Increased knowl¬ 
edge of the primary mental abilities will facilitate the type of experiment 
by which the specificities of particular tests may be reduced. It will prob¬ 
ably be found that a considerable fraction of the total variance of each test 
is attributable to factors of such limited social significance that the com¬ 
plete elimination of the specificity of each test will not be essential in the 
early stages of the scientific study of human abilities. 

Summary of terminology and notation 
The tenninology for the different parts of the variance of a test is sum¬ 
marized as follows: 

Total variance = 1 = h) + h) + e) = h) u) ) 

Reliability = ra = Kj + b) = 1 — e) ] 

Communality = hf = hj = 1 — uj; 

Spedficiiy = = bj ; 

Uniqueness = uj = bj -h ej ; 

Error variance = e) — e* = 1 — ryy. 

The notation for scores, matrices, and matrix elements is as follows: 

N = number of individuals in experimental population; 

3 , h =two subscripts for tests; 
syi = standard score of individual i in test j; 
i = subscript for individual in experimental population; 
m, Af=two subscripts for arbitrary orthogonal reference abilities or 
factors; 

Xmi = standard score of individual i in reference ability m; 
cjm =test coefficient of teat j for the factor m; 
r =number of common factors in correlation matrix; 
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n = number of tests in the battery; 
fjf, = correlation between tests j and k; 

Vj] = reliability of test j; 

ajm =te 3 t coefficient of test j in the common factor m; 

Fi = complete factor matrix for total variance of ciich test; 

F =redueed factor matrix for common-factor variance in each test; 
P = population matrix with elements Xnt; 
bj = specific factor loading in test j; 

— error factor loading in test j; 

Uj = unique factor loading in test j; 

S = score matrix with elements sjt; 

(Ty = total variance of test j=1; 

(T* = variance of scores aimi = 1; 

Ri = complete correlation matrix with unity in diagonal cells; 

R “reduced correlation matrix wth communalitics in diagonal cells. 



CHAPTER III 
GEOMETRICAL MODELS 
Geometrical representation in factor analysis 

In understanding the relation between the factor matrix F and the corre¬ 
lation matrix R, it will be helpful to consider a set of geometrical models. 
The algebraic development of factor theory could be represented by several 
different geometrical analogies, but we have selected one that seems to be 
the simplest and most direct, and it will be used throughout this text. In 
this chapter we shall consider the geometrical representation of problems 
that involve only two common factor's. These problems can all be represent¬ 
ed by two-dimensional diagrams. In later chapters we shall extend the same 
kind of geometrical interpretation to problems involving three common 
factors which can be represented by three-dimensional models. The same 
geometrical interpretations will then be extended to the n-dimcnsional 
methods of multiple-factor analysis. Most students find it very helpful to 
visualize the problems of factor analysis by geometrical representations. 

Factorial structure 

In Figure 1 we have represented a problem that involves eight tests with 
two common factors. The correlational matrix R is shown at le in the figure 
and the factor matrix F is .shown at Ih. 

The factor matrix F will now bo given a .simple geometrical interpreta¬ 
tion. Let the entries in each row represent the co-ordinates of a point in the 
diagram at la in the figure. The fimt row gives the factor loadings .70 and 
.30 for test 1. These two numerical values are interpreted as the co-ordinates 
of a point which is plotted in the diagram la. This point is the terminus of 
the teat vector 1. The test is now represented by a test vector. Each of the 
eight tests in the factor matrix F is represented in a .similar manner in the 
diagram at la, and we then have as many test vectors in the diagram os 
there are rows in the factor matrix F, In addition, we have the two unit 
reference vectors A and B, which represent the factors that are shcjwn by 
the columns of F. The comhinalxon of the lest vectors and the reference vectors 
for a test battery is called a factorial structure.* The factorial structure for 
the present illustrative example is shown in the diagram at la. 

In the factor matrix there are four tests, namely, 1, 3, 4, 7, which have 
non-vanishing entries in both columns of F. These are represented in the 
middle of the first quadrant of Figure la. Two of the testa—2 and 5—have 

^ * These definitions of structure and related concepts are the same as in the writer’s 
original publications on multiple-factor analysis (1931-35). 
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non-vanishing entries only in column A. These two tests have corresponding 
test vectors that are collinear with the reference vector A. Two other tests 
—6 and 8—have non-vanishing entries only in column B of F. These are 
represented in the corresponding structure by test vectors that are collinear 
with the reference vector B. 

The geometrical representation of the test battery can be generalized in 
the statement that each factor loading ajm in E is represented as a projection 
of the test vector j on the reference axis m. The first test vector has a projection 
of .70 on the reference vector A and a projection of .30 on the reference vector 
B. The second test vector has a projection of .90 on the reference vector A 
and zero on the reference vector B, This means that the second test vector 
is orthogonal to the reference vector B, If a factor loading ajm in F is zero, 

n 


J 

k 


Fiqube 2 

the geometrical interpretation is that the corresponding test vector j is orthogonal 
to the reference vector m. 

Correlations as scalar products 

The intercorrelations can also be represented geometrically in a very use¬ 
ful way. Each of the tests is represented in Figure fo as a test vector. It 
will be shown that the comelation between any two tests is the scalar prod¬ 
uct of their test vectors. The scalar product of two vectors j and k is 
hjhi, cos (hjh, where hj and hi, denote the lengths of the vectors and is their 
angular separation. 

In Figure % we have represented two test vectors j and k, whose lengths 
are hj and hh, respectively. Adjacent to the figure is also the factor matrix 
for the two tests j and k in their own plane with orthogonal axes I and IL 
The factor loadings, oyi and oya, are the projections of the test j on the two 
orthogonal axes, as shown in the figure, and a similar interpretation applies 
to the factor loadings, ak\ and a^] of test k. 

The correlation ry* between the two tests can be determined by the prod- 
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uct of the factor matrix and its transpose. The intercorrelation is then the 
cross product of the two rows of the factor matrix, namely, 

(1) r,A = flyifflii + 0/20*8 • 

Dividing by AjAit, we obtain 


( 2 ) 

ryjb 

0/1 

- A/ ‘ 

0*1 , 0/2 
A* hj 

but 




(3) 


0/1 

A/ 

cos 0/1 , 

(4) 


0*1 

A* 

cos 0*1 , 

(5) 


II 

sin 0 / 1 , 

( 6 ) 


0*2 _ 
A* 

sin 0 * 1 , 


where and ^ti are the angular separations between the test vectors j and 
k from the first reference axis. We have, therefore, 

(7) ^ = cos 0/1 cos 0 M + sin 0 yi sin 0 ti. 

The angle 0 /* can be expressed as the difference between 0 ^i and 0 *i, so 
that 

(8) 0/t = 0/1 — 0*1; 

but the right-hand member of equation (7) is the expression for the cosine 
of the difference between the angles 0 ,i and 0 *i. Hence we have 

(9) = 
or 

(19) fjfc = hjhk cos 0/*. 

The correlation between any two tests is equal to the scalar product of their test 
vectors. 

An important fact about this theorem is its independence of the reference 
axes. It should be noted that equation (10) does not involve the reference 
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axes. Since the scalar product is determined only by the lengths of the vec¬ 
tors and by their angular separation, the scalar -product of a pair of vectors is 
irwariant under rotation of the reference frame. We can now make an inference 
which involves one of the central ideas in factorial theory, namely, that the 
correlation matrix determines the test vectors as to their lengths and angular re- 
laiions, bid the correlation matrix does not define the location of the reference 
axes. 

With the scalar-product interpretation of the correlation coefficient, it 
follows that a negative coefficient is always represented by an obtuse an¬ 
gular separation of the test vectors, the lengths hj and h), being taken as 
positive. Also, with non-vanishing lengths of the vectors, a zero correlation 
is represented geometrically by a right angle. A pair of tests vnth zero cor¬ 
relation have orthogonal test vectors. 

If two vectors are each of unit length, then the numerical values of A# 
and hh are both unity, and their scalar product is the cosine of their angular 
separation. But cos 0,* is also the projection of either unit vector on the 
other. Hence we have the theorem that the scalar product of a pair of unit 
vectors is equal to the projection of either vector on the other. 

If the entries in the correlation matrix are all positive, as is the case with 
tests of the cognitive or intellective functions, then all pairs of test vectors 
are separated by acute angles. It follows that if all the correlations are 
positive, the configuration of test vectors lies inside a cone of ^5“ generating 
angle. 

The configuration 

The correlation matrix of Figure le contains all the correlations for the 
eight-test batteiy. Since only two common factors are involved in these cor¬ 
relations, the rank is 2, and it is possible to represent the test relations by a 
set of eight test vectors in two dimensions. The lengths of the test vectors 
are determined by the diagonal entries in the correlation matrix. Each diag¬ 
onal entry Af is the communality of a test j ,and the length of the correspond¬ 
ing test vector is hj. The angular separations between the test vectors are de¬ 
termined by the side entries of the correlational matrix in such a way that 
the scalar products of all pairs of vectors are equal to the corresponding cor¬ 
relations. The number of the dimensions that are required to represent the 
given correlations is the same as the rank of R, and this is the same as the 
number of common factors in the test battery. 

If we consider only the arrangement of the test vectors among them¬ 
selves as determined by the correlation coefficients and without regard to 
any reference frame, we call the ai-rangement or grouping a configuration of 
test vectors. The configuration of test vectors for the present example is 
shown in Figure Id. The configuration at Id is identical with that at la. 
The only difference is that the configuration and the reference axes are com- 
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bined to form a structure at la, whereas the configuration alone is shown at 
Id without any reference frame. The configuration has been drawn inten¬ 
tionally in different positions at la and Id. 

There is an exact relation between the test configuration at Id and the 
correlation matrix at le. A model or diagram of the configuration can be 
constructed from the con’elations, and the reverse is also possible, in that 
the correlations can be computed from the configuration. We loSe no infor¬ 
mation in going from the correlations to the configuration or vice versa be¬ 
cause th^ are merely two different ways of stating the same facts. It should 
be noted especially that neither the correlaiions nor the configuration has any 
reference frame. 

Just as there is a direct correspondence between the correlation matrix 
and the test configuration, neither of which involves a reference frame, so 
there is a direct correspondence between the factor matrix and the factorial 
structure, both of which do involve a reference frame. The pairs have been 
placed adjacent to each other in Figure 1 to emphasize these relations. The 
test structure cannot be defined until the reference axes have been located 
in the configuration, as shown in Figure la. In the same manner, the factor 
matrix at lb cannot be defined except in terms of a particular set of refer¬ 
ence axes which are implied by the two columns of that matrix. 

A factor problem usually starts with a table of intercorrelations, as shown 
in Figure 1 e. If it were determined that the rank of that matrix is 2, then we 
should know that the intercorrelations of the eight tests are produced by two 
common factors even before we could have any idea what these two factors 
are. We would also know that the configuration of test vectors would be con¬ 
tained within two dimensions, so that they could be represented as a plane 
diagram, os shown at Id. When the correlational matrix is given, including 
the diagonal entries, then the configuration can be drawn. It should be espe¬ 
cially noted that the correlation matrix and the test configuration have no 
reference axes. 

The object of a factorial problem is to write a factor matrix F that will re¬ 
produce the correlations R by the fundamental theorem FF' = R. This prob¬ 
lem can be represented geometrically. It consists in determining the rank 
of R, which is also the number of dimensions in the test configuration, and 
the rank is also the number of columns,of the factor matrix F. The con¬ 
figuration can then be drawn uniquely. A set of reference axes can then be 
inserted into the configuration to form the structure at la. When the ref¬ 
erence axes have been inserted into the configuration, it is possible to de¬ 
termine the projection of each test vector on each one of the reference axes. 
These projections constitute the cell entries o/m of the factor matrix F. It 
should be clear, then, that the factor matrix cannot be written until a set 
of reference axes has been inserted into the configuration which is defined 
by the intercorrelations. 
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Certain features of the test configuration can be inferred by mere inspec¬ 
tion of the correlation coefficients. If all the correlations are positive or 
zero, we can infer that all the teat vectors are separated by acute angles. 
The largest angular separation would then be a right angle. It follows that 
the whole test configuration must be contained within a cone of 45® gen¬ 
erating angle when the correlation matrix has no negative entries. This is 
the situation with psychological teats of the cognitive or intellective func¬ 
tions, which seem never to show any significant negative correlations. 

The arbitrary reference frame 

Since the object of factor analysis is to find a factor matrix F from a 
given correlation matrix Ri so that the fundamental factor theorem FF' = R 
is satisfied, it is of interest to note that every correlation matrix can be fac¬ 
tored into a factor matrix. In fact, the correlation matrix is, by definition, a 
product of two score matrices, as has already been shown in (20-ii), 

(20-ii) ' 

Since the correlation matrix is obtained computationally as a product of two 
matrices, it is evident that every correlation matrix can be factored. We 
have, therefore, the theorem that/or every correlation matrix R there exists a 
corresponding factorial matrix P such that FF' = R. 

We have seen that a given correlation matrix can be interpreted as show¬ 
ing the scalar products of pajrs of test vectors. We have also seen that the 
factor matrix can be interpreted as showing the projections of each test 
vector on each of the co-ordinate axes. The numerical values of the projec¬ 
tions of the test vectors are, of course, dependent on where we put the fac¬ 
torial reference frame. Hence we have the important theorem that an in¬ 
finite number of factor matrices F can he written which reproduce any given cor¬ 
relation matrix R. This theorem makes it evident that when we have fac¬ 
tored a given correlation matrix R into a factor matrix F we do not have a 
unique solution. Further restrictions must be imposed on the solution F, 
so as to make it in some sense unique before we can hope to interpret the 
test coefficients. On this question there has been much controversy, which 
we shall have occasion to consider in a later chapter. 

In order to demonstrate the arbitrary location of the reference frame, we 
have drawn in Figure 3 several positions of the co-ordinate axes for one test 
configuration. The configuration of Figure Id is reproduced in three differ¬ 
ent positions in Figure 8 as regards the co-ordinate axes. Below each dia¬ 
gram in the figure we have the corresponding factor matrix. Although the 
numerical values are different in thrae three factor matrices, they all repro¬ 
duce the same correlations, namely, those of Figure le. 

Since the correlation matrix R consists of scalar products of test vectors, 
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while the factor matrix F shows the projections of the test vectors on the co¬ 
ordinate axes, we have several other theorems that are useful in under¬ 
standing the relations between these matrices, E and F . Considei' the test 
vector h and the unit vector X in Figure 4. The scalar product of these two 
vectors is cos which becomes A* cos 0*,*, since ^ is a unit vector. 
Let 2 be a unit vector collinear with k. Then the projection of ^ on X is 
cos But the projection of /c on Z is proportional to the length /i* of k. 
Hence the projection otkonXiahi cos We then have the theorem that 


n 


n 


I 



Fioubb 3 


ike -projedion of a vector on any given axis is the scalar product of the test 
vector and a unit vector collinear with the axis. 

Consider a set of test vectors k and a particular test vector j. We have 
seen that the projection of a test vector on Z is ft* cos </>**. This is the same 
as kk cos 4>ik, since 4>hx and tt>ik are the same angle. But the correlation Vjk = 
hjhk cos <j>jk. Hence the projection of the test vector Jb on a particular test 
vector j is 



(11) 
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Hence the coTrelations between a set of tests k and a particular test j are propor¬ 
tioned to the projections of the test vectors k on an axis collinear vrith the test vec¬ 
tor j. This theorem can be applied in the geometrical interpretation of a 
column, or row, j, of the correlation matrix. Such a row shows the correla¬ 
tions between a set of tests, k, and a particular test j. The configuration of 
test vectors corresponding to the correlation matrix satisfies the theorem 
that the correlations in any particular row or column, j, of the correlation ma¬ 
trix are proportional to the projections of the test vectors on an axis through the 
test vector j. This is merely a restatement of the previous theorem. The 
proportionality factor is l/hj, so that, if the length of a particular test vec¬ 
tor j is known or assumed, then one column of the factor matrix can be im¬ 
mediately written by (11) if we decide to locate one of the co-ordinate axes 



through one of the test vectors j. The projections Py arc then, in fact, the 
entries of one of the columns of the factor matrix. 

The same theorem can be restated in still another form that is important 
for factorial analysis, namely, that, for any given correlation matrix with an 
implied common-factor space, there exists in that space an axis through the 
origin on which the test vectors have projections that are proportional to the 
correlcUions of any given column, or row, of the correlation matrix. If the cor¬ 
relation matrix is of order n, there exist n such axes in its common-factor 
space. 

If the co-ordinate axes are located elsewhere in the common-factor space, 
the projections of the test vectors on these co-ordinate axes will be linear 
combinations of the projections on the axes through the test vectors. We 
infer a fundamental theorem in factorial theory, namely, that every column 
of factor loadings in the factorial matrix is a linear combination of columns of 
the correlational matrix. We shall make use of this theorem in designing dif¬ 
ferent methods of factoring the correlational matrix. 

It should be clear that any interpretation of the factor matrix must be 
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made in relation to the principles that are chosen for locating the co-ordinate 
axes in the configuration defined by the correlations. In general, the numeri¬ 
cal entries of the factor matrix are as arbitrai-y as the location of the refer¬ 
ence frame. It is only to the extent that the reference frame can be in some 
sense unique that the numerical entries of the factor matrix can be given any 
scientific interpretation. 

Sign reversals in the factor matrix 

When a reference frame has been inserted into the configuration and the 
projections of the test vectors computed os shown in Figure la and lb, it 
should be noted that the sense in which a co-ordinate vector such as A in 
Figure la is taken determines the signs of the projections in column A of 
lb. If the direction of the co-ordinate vector A is reversed, then all the 
signs in column A of the factor matrix are also reversed. If the reference 
vector A represented some fundamental human trait, such as cheerfulness, 
then the reversal of direction of the reference vector would represent the 
direct opposite, such as grouchiness. Since the scalar products of the test 
vectors are independent of the location of the reference frame, wo have the 
computationally useful theorem that the signs of all the entries in a column 
of the factor matrix may be changed without altering the corresponding correla¬ 
tion matrix. Computationally, this theorem becomes evident also if we con¬ 
sider the correlation coefficient as a cross product of a pair of rows of the 
factor matrix, such as Figure lb. If we reverse the signs in both a,„, and 
atm for a fixed column m, their product remains unchanged in sign so that 
the correlation coefficient r,* remains imchanged. The p.sychological inter¬ 
pretation of this reversal in direction of a reference vector can be shown in 
terms of the example given. The correlation between two traits remains 
unaffected by the arbitrary decision to call one of the component reference 
traits “plus cheerfulness” or “minus grouchiness." 

Now consider the reversal of all the signs in a row j of the factor matrix. 
This has the effect of reversing the direction of the corresponding test vector 
j. Its scalar remains the same, while its angular separation from any 
other test vector k is changed to the supplement of ^y*. Hence the absolute 
values of the correlations of this test with the other tests remain unaltered, 
but their signs are reversed. The psychological interpretation can be shown 
by an example, namely, that if one variable correlates positively with “plus 
tactfulness,” then it will correlate negatively with “mintis tactfulness,” 
which might be defined as “plus tactlessness.” 

We have, therefore, another useful theorem that if dll the signs are re¬ 
versed in a row of the factor matrix, then all the signs are reversed in the corre¬ 
sponding row and in the corresponding column of the correlation matrix. To 
reverse the signs of all entries in a row j of the factor matrix does not change 
the positive sign of the self-correlation of test j, since, by the theorem, the 
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signs are reversed in the row j and also in the column j of the correlation 
matrix. These two sign changes in the diagonal cell keep the sign of the self¬ 
correlation unaltered. This theorem can also be inferred from the factor 
matrix. If all the signs in a row of that matrix are reversed, then all the 
terms in a cross product of tow j with any other row k are similarly reversed 
in sign so that the correlation rjk is reversed in sign except the self-correla- 
tion of test j, which remains the sum of the squares of the entries in the 
row j. We can also infer from these relations that the self-correlation of a 
test remains positive for all possible reversals of sign of tests and footers. 

The restriction that r be less than n 

In the illustrative example of Figure 1 we have eight tests and two com¬ 
mon factors, so that n=8 and r = 2. There are certain inequalities relating r 
and n which must be satisfied in order that a determinate factor solution 
shall be possible. To introduce these restrictions, consider the case in which 
r>n. This case is illustrated in Figure 6 , which shows a factor pattern of 

1 

2 
3 

five common factors and three tests. The crosses represent non-vanishing 
factor loadings in the factor matrix. Assume that the five common factors 
are uncorrelated. The correlations between the three tests determine the 
correlation matrix, which is of order 3. The rank of that matrix cannot ex¬ 
ceed 3, but we have set up the problem to represent more than three com¬ 
mon factors. If such a correlation matrix were factored, it would give a fac¬ 
tor matrix of not more than three columns or factors. The numerical entries 
in such a factor matrix would determine the correlations exactly, but the 
three factors would probably be artifacts as far as any scientific problem is 
concerned. The relations might have some statistical interest, and they 
might be useful for constructing various empirical prediction formulae, but 
they would not reveal the five factors that were operative in the test vari¬ 
ances. Factor analysis is built on the postulate that the number of common 
factors does not exceed the number of tests in the battery. As far as a numerical 
solution is concerned, every correlation matrix can be factored routinely if 
we are willing to accept as many factors as there are tests. The scientific 
interpretation and validity of the factors is another matter. 

The geometrical interpretation of the postulate that r^n can be seen if 
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wG consider tlie configurfljiiioii of 7i tesii vectors. If these vectors o.rc defitied 
in terms of their components in more than n dimensions, the n vectors can 
also be described in an w-dimensional subspace which is spanned by the 
n vectors. That is the space defined by the factor matrix, from which it 
would not be possible to identify the larger number of factors that produced 
the test correlations. 

These considerations raise the question of how one can be sure that any 
particular battery of n variables really does involve le.ss than n common 
factors. There is no guarantee beforehand that any proposed battery of n meas- 
uremmts will involve less than n comimn factors that have significant interpre- 
toMon. To produce such a situation is as much dependent on scientific in¬ 
tuition as other scientific experiments are subject to intuition for success 
and significance. One can, of course, factor any given correlation matrix to 
determine its rank. If the rank of the correlation matrix turns out to bo com¬ 
parable with its order, one has merely made a bad guess, and one must start 
over again with a revised test battery in the same domain. 

The test space and the common-factor space 

The relation between the correlation matrix and the configuration i.s very 
markedly dependent on whether we insert unity or the communalitie.s in the 
diagonal cells of the correlation matrix. The principles involved hero can 
be illustrated in terms of the correlation between two tests, j and h. The 
correlation matrix would be of order 2. If we write unity in the diagonal 
cells, there will be only one correlation coefficient to determine, namely, r,-*. 
The corresponding configuration is a pair of unit vectors, whitsh are sepa¬ 
rated by an angle whose cosine is the given correlation coefficient. If we con¬ 
sider the tests of a battery as represented by unit vectors to cover the total 
vaiiance of each test, then we have a configuration of n unit vectors in a 
space of (n-t-r) dimensions, which represent the common factors and the 
unique factors. Such a space is called the test space to distinguish it from the 
space that is defined by the common factors, which is called the common- 
factor space. Since the test space represents usually more factors or param¬ 
eters than there are tests, we shall not use it except in special problems 
where the total test space is indicated. The total test space is of n dimen¬ 
sions if we disregard the factorial composition of the tests. 

Summary of geometrical concepts 

The geometrical representations described in this chapter will bo summa¬ 
rized here. These theorems and defimtions are all applicable to factor prob¬ 
lems with any determinate number of factors or dimensions. 

The factor matrix and the cortfiguraiwn 

1) A reference frame must be inserted into the configuration before any 
factor matrix can be written. 





GEOMETRICAL MODELS 


99 


2) Since the co-ordinate axes are not determined by the experimentally 
obtained correlation matrix, every factor matrix is in the nature of a fac¬ 
torial interpretation of the given correlations. 

3) Each row of the factor matrix can be interpreted as showing the rec¬ 
tangular components of a test vector. 

4) Each column of the factor matrix identifies a factorial axis in the 
structure. 

6) Each reference factor is represented by a unit reference vector. 

6) The graphs on which are plotted pairs of columns of the factor matrix 
show the factorial structure which combines the test vectors and the refer¬ 
ence frame. 

7) If the components of an orthogonal factor matrix are all positive or 
aero, the structure has all test vectors in the first quadrant or octant. 

The correlation matrix and the configuration 

8) The correlation matrix can be interpreted as showing the scalar prod¬ 
ucts of all pairs of test vectors. 

9) The length of each test vector is equal to the positive square root of 
its communality. 

10) The correlation matrix with known diagonal entries determines a 
unique configuration of test vectora that can be represented as a physical 
model if the rank of the matrix is less than 4. 

11) The correlation matrix does not determine any reference frame, 

12) If the dimensionality or rank is less than 4, a physical model can be 
constructed to show the configuration alone or the factorial structure which 
includes the configuration and the reference axes. 

13) No information is lost in representing the correlation matrix as a 
configuration, or vice versa. 

14) A correlation matrix with coefficients that are all positive or zero 
determines uniquely a configuration of test vectors in which there are no 
obtuse angular separations. 

15) The scalar product of a pair of vectors is invariant under rotation of 
axes. 

10) The scalar product of a pair of unit vectors is equal to the projection 
of either vector on the other. 

17) A positive correlation coefficient represents a pair of test vectors with 
acute angular separation. A negative correlation represents a pair of test 
vectors with obtuse angular separation. 

18) The projection of a test vector on any given axis is the scalar product 
of the test vector and a unit vector collinear with the axis. 

19) The correlations between a set of tests k and a particular test j are 
proportional to the projections of the set of test vectors h on an axis collinear 
with the test vector j. 



100 MULTIPLE-FACTOR ANALYSIS 

20) Given a correlation matrix with an implied common-factor apace, 
there exists in that apace an axis through the origin on which the test vectors 
have projections that are proportional to the correlations of any column, 
or row, of the correlation matrix. 

21) Every column of factor loadings in the factor matrix is a linear com¬ 
bination of columns of the correlation matrix. 

Sign reversals in the factor matrix 

22) The signs of all the entries in a column of the factor matrix may be 
reversed without altering the corresponding correlation matrix. 

23) Reversing the signs in a column of the factor matrix rever.sc.s the di¬ 
rection of the corresponding reference factor and reference vector. 

24) If all the signs are reversed in a row of the factor matrix, then all the 
signs are reversed in the corresponding row and in the corre.sponding column 
of the correlation matrix, 

26) To reverse the signs in a row of the factor matrix reverses tlie direc¬ 
tion of the corresponding test vector. 

26) The self-correlation'of a test remains p(j.sitive for all po-ssible rev(5r.snls 
of sign of tests and factors. 



CHAPTER IV 

A FACTOR PROBLEM IN TWO DIMENSIONS 
Introduction 

So far we have considered the assumptions of factor analysis, the funda¬ 
mental equations, and some of the geometrical concepts of factor theory. 
In discussing the sections of Figute 1 in chapter iii we have seen the rela^ 
tions between the factor matrix, the factorial structure, the test configura¬ 
tion, and the correlation matrix. We shall now consider the illustrative 
problem of that chapter as if it were a factor problem to be solved. The 
problem starts with the given correlation matrix, which is ordinarily de¬ 
termined from experimental data. The problem now is to analyze the cor¬ 
relation matrix so as to discover the factor matrix F and the structure as 
shown. The correlation matrix of the previous chapter will be used now as 
the given data, and we shall determine from it the factor matrix. It is a 
simple matter to construct a correlation matrix from a given factor matrix, 
but it is usually more difficult to extract the factor matrix from a given cor¬ 
relation matrix. It is the latter which constitutes factor analysis, where the 
experimental data are in the form of correlation coefficients from which a 
factor matrix is to be found. 

The solution of a factorial problem consists usually of two steps, namely, 
(1) to factor the given correlations into a factor matrix with arbitrary ref¬ 
erence frame and (2) to rotate the arbitrary reference frame into a pre¬ 
ferred or simplifying position. The first is known as the factoring problem, 
and the second is known as the. rotational problem. We shall describe both 
steps for the present example. There are several methods of factoring a cor¬ 
relation matrix, and there are several methods of solving the rotational 
problem. In fact, most of the theory and computational methods of factor 
analysis are concerned with these two'main problems. Here we shall start 
with perhaps the simplest of the factoring methods, namely, the diagonal 
method. 

The diagonal method of factoring 

Before proceeding to the factorial solution of the correlation matrix of 
the previous chapter, we shall describe the diagonal method of factoring 
by a small five-variable matrix in Table 1. This method of factoring is not 
well suited to large problems involving fallible data, but it is a simple rou¬ 
tine method that can be used on a correlation matrix of any order and 
any rank. 

The correlation matrix of Table 1 will be used to illustrate the diagonal 
method of factoring. The total number of independent correlation eoeflfi- 
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dents is in{n+l) if the diagonal entries are included. Since the correla¬ 
tion matrix of Table 1 is of order 5, there are fifteen correlation cocfTicients 

Tahle 1 


Correlation Matrix 



I 

a 

s 

4 

(i 

1 

.85 

.28 

.30 

.82 

.18 

2 

.28 

.80 

.40 

.Ui 

.50 

3 

.36 

.40 

.61 

.54 

.53 

4 

.82 

.16 

.54 

.97 

.27 

6 

.18 

.56 

.53 

.27 

.58 


R 


available for determining the factorial matrix. 

The corresponding factor matrix is shown in literal form in Table 2 and in 
numerical form in TaSble S. In Table 2 all the entries above the principal 


Table £ Table 3 

Factor Matrix Factor Matrix 
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n 

III 

rv 
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n 

III 

IV 

V 

1 

au 

0 

0 

0 

0 

1 

.922 

(1 

« 

(1 

0 

2 

Ost 

Oa 

0 

0 

0 

2 

.304 

.841 

0 

0 

(1 

3 

Cjl 

dn 

d]9 

0 

0 

3 

.300 

.335 

.588 

0 

0 

4 


d4] 

043 

044 

0 

4 

.880 

-.131 

.‘103 

■ OlH) 

0 

5 

dn 

du 

033 

034 

033 

5 

. 105 

. .505 

.‘133 

.(H«) 

.(KK) 


F F 


diagonal are zeros. This circumstance will be explained in two wny.s, name¬ 
ly, geometrically in terms of the arbitrary location of a referuiu'c frame and 
algebraically in terms of the correlations expre.ssed a.s cro.s.s products of 
rows of F. It should be noted that the number of cooflicieuts to be deter¬ 
mined in ToNe 2 is exactly equal to the number of correlation ciudlicients 
in Table 1. It will be shown that each correlation eo(jnici(‘nt in /f det(;rminos 
one of the factor loadings in F, so that the method can he <(xtended to the 
case where the rank of R is equal to its order, in which cu.se t he number of 
factors in F is equal to the number of variables in Ji. When tJie runic of R 
is less than its order, it will be found that a smaller number of eolunms will 
be required in F, In the present example the rank of R is 3, and hence the 
last two columns of Table 3 contain only zeros. 

The zero entries in TaMe 2 can be explained in terms of the arbitrary 
reference frame. Let the first axis be collinear with the first test vector. 
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Then this vector will have a projection on the first axis equal to the length 
of the vector, namely, the square root of its communality. The test vector 
will have zero projections on all other possible axes that are orthogonal to 
tlie first axis. Hence the remaining entries in the first row of F are all zeros. 

The second axis may be placed orthogonal to the first axis and in the 
plane that is spanned by the first two test vectors. Then the second test 
vector will have projections on the first two axes but not on any others. 
Hence all but the first two entries in the second row of F wiU be zeros. The 
third axis may be placed in the space spanned by the first three test vec¬ 
tors and orthogonal to the first two axes. The third test vector will then 
have projections on the first three axes but not on any of the other axes. 
We are assuming that the successive tests that are used for the location of 
the reference frame are so chosen by inspection that they are linearly inde¬ 
dependent. The manner of doing this will be shown in the numerical ex¬ 
ample. The fourth axis is placed orthogonal to the first three axes and in 
the four-dimensional subspace that is spanned by the first four test vectors. 
Hence the fourth teat vector will have projections on the first four orthogo¬ 
nal axes but not on any of the other axes. This process is continued until a 
sufficient number of dimensions has been defined to account for the scalar 
products of the correlation matrix. This location of the reference frame 
produces a set of zero entries in the upper half of the factor matrix, as 
shown in Table 2. The zero entries of this table can be inserted at the start 
of the factoring. 

The triangular arrangement of zeros in Table 2 can also be explained 
algebraically in terms of the cross products of F that must reproduce the 
correlations in R. The sum of the squares of the first row of Table 2 is 
equal to the communality of test 1. Since there is only one entry in the 
first row of F, we have 


ail = = .922 , 


and this is recorded in Table 3. 

The cross product of the first two rows of F must reproduce the correla. 
tion r2i=.28. Hence we have 


aiiflii = .28, 

.922021 = .28, 

021 ~ .304. 

The correlation between the first test and any other test j becomes 


(1) 


a\\aj\ = Tji, 
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or 

( 2 ) 



1 

,922 


r/i • 


The entries in the first column of Tahle 3 arc therefore i>roiK)rtional k) the 
first column of correlation coefficients in R, as shown in erjuation ( 2 ). 

When the first column of the factor matrix has bexm recorded, we turn to 
the communality of the second test, which is the sum (»f the squares of the 
entries in the second row of F. Hence 


ail + alt = .80, 

in which is the only unknown. It can therefore be tletorniiTied and it 
recorded as .841 in Tahte 5. 

The correlations of the second te.st with any other tc.st j can he written 
in the form 

diidn + Oisflis = r/2, 

m which ay* is the only unknown. The second column of Table S is thus 
numerically determined. 

The communality of the third teat is, similarly, 

3 

" ^3S f 

m«l 

m which is the only unknown. It is recorded as .688 in 7’ablf: 3. 

The correlation of test 3 with any other tost .7 can ho written 




m-1 


in which oy, is the only unknown. Hence the third column of Table S be¬ 
comes numerical^ determined. 

b ® ">» PTOt™ 

tab tC bP f™"'! t" van- 

msthod of factoring, the acloollon of oai'li buitc»«1to l.«t 
ohouM b. on tho baota of the roaidual variancoa of Iha ta a ™r o“ 

r"“ f * * 

tbaae sunw rritb tbo m * squares of oacb rew of fi' and oompare 
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The practical limitation of the diagonal method of factoring for fallible 
data is that the method pivots on one test at a time. The choice of a diagonal 
entry which is estimated with practical data determines the factor loadings 
in a manner which is very sensitive to errors in the estimations for the 
diagonal cells. In general, computing methods are preferred in which all 
the data contribute to the determination of each parameter by summations. 
However, the diagonal method is theoretically correct, and it can be used 
as a routine computational method of factoring where the given correla¬ 
tional entries can be regarded as exact. 

A two-dimensional example 

The correlation matrix in Figure 1-iii has been reproduced here as 
Table 4, and it will be factored by the diagonal method. We choose arbi- 


TahU U 

Correlalion Matrix 
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2 

3 

i 

6 

0 

7 

s 

1 

.£8 

.63 

.46 

.61 

.36 

.18 

.46 

.24 

2 

.63 

.81 

.36 

.64 

.46 

.00 

.27 

.00 

3 

.46 

.36 

.62 

.42 

.20 

.36 

.60 

.48 

4 

.61 

.54 

.42 

.45 

.30 

.18 

.42 

.24 

6 

.36 

.46 

.20 

.30 

.26 

.00 

.16 

.00 

0 

.18 

.00 

.36 

.18 

.00 

.36 

.48 

.48 

7 

.45 

.27 

.60 

.42 

.16 

.48 

.73 

.64 

8 

.24 

.00 

.48 

.24 

.00 

.48 

.64 

.64 

2 

3.40 

3.06 

3.40 

3.06 

1.70 

2.04 

3.74 

2.72 


trarily the first test to determine the first reference axis. The communality 
of test 1 is .58, and hence the desired multiplier is 1/V^ = 1.313064. 
Applying this stretching factor on the first column of correlations in Table 4t 
we obtain the first column of factor loadings which are entered in Table 8. 

The computational checks have been included in this example. First, we 
sum the columns of Table 4, as shown in row S. The sum for the first col¬ 
umn, 3.40, is treated as an additional entry in this column. Applying the 
stretching factor to it, as for the correlation coefficients in the first column, 
we have 4.464, which is recorded in Table 8, row Ch. The actual sum of 
that column of Table 8 is 4.466. Since the predicted check sum {Ch) agrees 
with the actual sum (S) in Table 8, we assume that the computations and 
the copying into the table are correct. We shall not specifically mention 
each check sum, since the principle is essentially the same for the rest of 
the computations. Almost every novice in computing minimizes the im¬ 
portance of formal computational checks. After he has wasted some days 
hunting for his errors, he learns that it saves both time and annoyance to 
proceed with formal explicit checks at every step in computing. In the 
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publication of computational results it is not custoinary to distruft the 
reader with the computational checks. 

When the first column of the factor matrix in Table S ha.s bcf>n numerical¬ 
ly determined, the cross products of this column arc listed as .shown in 
Table 6. The summation in Table 8 is here again treated as iiii additional 
entry, which gives tow Ch in Table 5. This table shows tin? ef)ntribiitioji.s 
made'by the first reference factor to the given correlations. 

Table 6 

Firat-Factor Products oyioti 



1 
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a 
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fi 

G 

7 
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1 

.681 

.630 

.460 

.511 

.351 

.180 

.450 

.240 

2 

.630 

.684 

.500 

.654 

.380 

.195 

.480 

.261 

3 

.460 

.600 

.366 

.405 

.278 

.143 

. 3.67 

.190 

4 

.611 

.654 

.406 

.449 

.308 

. 1.68 

.396 

.211 

6 

.361 

.380 

.278 

.308 

.212 

.109 

.272 

. 14.6 

6 

.180 

.195 

.143 

.168 

.109 

.050 

.139 

.074 

7 

.460 

.489 

.357 

.300 

.272 

.139 

.349 

.186 

8 

.240 

.261 

.190 

.211 

.145 

.074 

.186 

.099 

Ch 

3.402 

3.693 

2.697 

2.902 

2.064 

1.054 

2.639 

1.400 

S 

3.403 

3.693 

2.698 

2.002 

2.066 

1 . 0.64 

2.638 

1.400 
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-.001 
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.120 
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-.014 
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-.219 

-.201 

3 
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-.140 
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.015 

-.078 

,217 

.213 

.290 

4 

-.001 

-.014 

.015 

.001 

-.008 

.022 

.024 

.029 

6 
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.070 

-.078 

-.( K ® 

,038 - 

-. 10 !) 

-. 122 

-.145 

6 

.000 

-.196 

.217 

.022 

-. 109 

.301 

.341 

.406 

7 

.000 

-.219 

.243 

.024 

-.122 

.341 

.381 

. 4.64 

8 

.000 

-.201 

.290 

.029 

-.145 

,400 

. 4,61 

.541 

Ch 

-.003 

-.033 

.702 

.068 

-. 3.65 

.080 

1.102 

1.314 

S 

-.003 

-.033 

.702 

.068 

-.355 

.080 

1.102 

1.314 


The cross products shown in Table 6 uro subtracted from tlu! correla¬ 
tions in TcMe /i.. These are denoted 

~ = I'S.jk I 

which are shown in Table 6. The subscript 2 in r 2 .it r(‘for.s to tin* fact that 
these are residual correlations from which the second facl«)r loiiLlings are 
to be determined.* Table 6 can now be treated ju.st like Table Jf, in order 
to determine the next column of factor ]oading.s. 

* In some of our previous work we have used the natation r,.,, to represent second- 
factor residuals instead of first-factor residuals, as in this problem. 
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Column 8 in Table 6 shows the highest diagonal entry, and we therefore 
choose it as the second pivot test. The residual communality for test 8 is 
.541, so that the multiplying factor is now 1/V.541 = 1.359569. Apply¬ 
ing this stretching factor to column 8 of Table 6, we get the second column 
of the factor matrix in Table 8. 


Table? 


SeeondrFaetor Products a/^aia 



1 1 

1 

s 

3 

4 

6 

a 

7 

8 

1 

.000 

.000 

.000 

.000 

.000 

.000 

.000 

.000 

2 

.000 

.126 

-.140 

-.014 

.070 

-.196 

-.219 

-.261 

3 

.000 

-.140 

.156 

.016 

-.078 

.217 

.243 

.290 

4 

.000 

-.014 

.016 

.002 

-.008 

.022 

.024 

.029 

5 

.000 

.070 

-.078 

-.008 

.039 

-.109 

-.122 

-.145 

6 

.000 

-.196 

.217 

.022 

-.109 

.305 

.341 

.406 

7 

.000 

-.219 

.243 

.024 

-.122 

.341 

.381 

.454 

8 

.000 

-.261 

.290 

.029 

-.146 

.406 

.464 

.642 

Ch 

.000 

-.034 

.704 

.070 

-.362 

.986 

1.102 

1.314 

2 

.000 

-.634 

.702 

.070 

-.363 

.986 

1.102 

1.315 


Table 8 


Factor Matrix F 


Table 9 



I 

II 

1 

.762 

.000 

2 

.827 

-.356 

3 

.604 

.394 

4 

.670 

.039 

6 

.460 

-.197 

6 

.236 

.662 

7 

.591 

.617 

8 

.316 

.736 

Oh 

4.464 

1.786 

2 

4.466 

1.786 


d .68 .641 


VS .701677 .736627 
1/VS 1.313066 1.359509 


Gwen Factor 
Matrix 



I 

II 

1 

.762 

.000 

2 

.827 

-.355 

3 

.604 

.394 

4 

.670 

.039 

6 

.460 

-.197 

6 

.236 

.652 

7 

.691 

.617 

8 

.316 

.736 


Fi 


Transformation Rotated Factor 
Matrix Matrix 



A B 

A B 

I 

II 

1 

Xio Xii 1 

X 2 a Xab 2 

3 

,70 .30 

.90 .00 
.40 .60 
.60 .30 

.50 .00 

.00 .60 
.30 .80 

.00 .80 

4 1 

e 1 


- W 1 

6 

A B 'J 

I 

II 

.917 .400 * 

— ,4UU .yi7 

ft 

A 


The cross products of the second column of the factor matrix give 
(ffly 2 afc 2 ), which are shown in Table 7. These are the contributions of the 
second reference factor to the correlations in Table 4. Subtracting the en¬ 
tries of Table 7 from the first-factor residuals rz.,* in Table 6, we find that 
they vanish, showing that the two factors in Table 8 are sufficient to ac¬ 
count for the given correlations. 



108 


MULTIPLE-FACTOR ANALYSLS 


Rotation in two dimensions 

The factor matrix of Table 8 has been plotted in Figure 1, wlnn-e we see 
the two-dimensional condguration and the arbitrary reference axes I and II. 
In choosing a reference frame for the interpretation of the variables in terms 
of factors, we must decide on some criterion by which to make the choice. 
The first axis might be passed through the centroid <jf the eight points in 
Figure 1, or the first axis might be so placed as to maximize the sum of the 
squares of the projections of the eight test vectoi's. Wc might place the 
axes in such positions that the negative projections wdll be. eliminated or 



Fioure 1 


minimized as far as possible. Another criterion which can Kometiincs be 
used is to place the axes so as to minimize what we Inive called the "com¬ 
plexities’' of the tests. When this criterion is upplhtable, the axe.s are so 
placed that a large number of zero entries appear in the factor matrix. The 
rotational problem is one of the most important in fiu‘tor unalyKia, 

In the present example we see in Figure 1 that the angular span of the 
configuration is a right angle, so that a frame can be chosen which eliminates 
all negative factor loadings and which reduces the complexities of four 
tests to one instead of two. The two axes chosen by the.se criteria are de¬ 
noted A and B in the figure. 

The numerical problem now is to write a factor matrix which will repre¬ 
sent the two orthogonal factors A and B instead of the arbitrai'y orthogonal 
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factors I and II, which appeared in the factoring of the correlation matrix. 
In Table 9 we have the factor matrix Fi for the axes I and II (from Table 8), 
and we want to find an orthogonal transformation matrix A so that FiA= 
Ft, where Ft will be a factor matrix for the axes A and B* The notation 
Fi, Ft, Ft, ••• , will henceforth be used to represent successive rotations 
of the reference frame. 

Since the present configuration of test vectors is contained in two dimen¬ 
sions, the orthogonal transformation A will be of order 2X2. It will be 
useful to make a geometrical interpretation of the cell entries in the matrix 
A of the transformation. The cell entries in the first column A of this matrix 
are denoted Xia and "Kta. These are the direction cosines of the unit vector A 
referred to the frame I-II. Another way of saying the same idea is that the 
unit vector A in Figure 1 can be expressed as a vector sum of its projections 
on the axes I and II. We have, then, for the vector A, 

(4) A = + \JI. 

The first column A of the orthogonal matrix A in Table 9 states that the 
vector A is Xio of the unit vector I plus Xso of the unit vector II. In Figure 1 
these coefficients of equation (4) can be determined graphically. Since A is 
a unit vector, we shall expect that 

(6) X?„ + Xia = 1. 

By inspection of Figure 1, and normalizing, we have 

(6) , A = .9171 - .400 II, 

and these coefficients are entered in the numerical form of the transforma¬ 
tion matrix A in Table 9, 

A similar interpretation applies to the second column B of the transfor¬ 
mation matrix. From the figure we obtain close estimates of the projec¬ 
tions of 5 on J and II, namely, Xu and \tb, which, when normalized, give 
the unit vector B as the vector sum, 

(7) R = .4001 +.917 7/. 

In Table 9 it should be noted that the rows of the transformation matrix 
refer to the axes 7 and 77, while the columns refer to the axes A and B. If 
we perform the matrix multiplication 

( 8 ) FiA = Ft, 

* For t-hi^nreyis related to rotation of axes see "Mathematical Introduction" and 
theorems in chap, Hi, 



no 


MULTIPLIO-FACTOR ANALYSIS 


the product is of order nX2, and the coliinnis are ilenoted A and 1} u- 
has been done in Table 9, where A is the desired fuetdr matrix for the f 
tonal axes A and B. This matrix is identieal with the factor nvitriy 
which we started in diapter Hi. ' 

In writing this factorial solution, we might havti labeled the two -ixi® a 
and B m reverse order in the figure, or we might have; rov(;r,st;d the order nf 
the two columns of the transformation matrix A. Tim elTeft would h ' 
been merely that the columns of F, would appear in a diiTeront ordeal! 
should be evident that the order m which the cohmins of Fj are written 
would have no effect on the interpretation of tlm factors in terms of thlStT 

The extension of the reasoning illustrated liere to thnai „r more dWn 
sions involves essentially no new ideas, although the higher-dimon rj 
problems are more complex. In problems involving nuu/coininon hI? 

1 IS more difficult, for example, to identify the nature of the configuration 
which IS obvious in a single diagram in two dim.uisi.m.s. ^ ’ 



CHAPTER V 

THE GROUPING METHOD OF FACTORING 

The diagonal method of factoring a correlation matrix has been described 
in chapter iv. While that method is simple in principle, it has a serious dis¬ 
advantage when dealing with fallible data, namely, that it pivots succes¬ 
sively on single teats and on single correlation coefficients. If any of these 
individual coefficients is in error, the calculations that are based on them 
are similarly in error, so that the residuals become larger than when some 
summational procedure is used. For this reason the centroid method was 
developed. The grouping method to be described here is a variant of the 
centroid method. 



Figubb 1 

Consider the correlation matrix ryt in Figure 1. Instead of summing 
over all the variables, which is the starting-point for the centroid method, 
we shall sum here over a group of tests. The group should contain at least 
three or four tests. The successive groups to be used should be so selected 
that the intercorrelations of the tests within one group are large, relative 
to the magnitudes of the coefficients in the table. Detailed routine for 
selecting the groups will be shown in the numerical example. Let there be s 
tests in the selected group. Let the rows of the selected group be denoted 
by the subscript m, and let the corresponding columns be denoted by the 
subscript v. Let the rank of the correlation matrix be r. 

Let us augment the correlation matrix by a row, as shown in Figure 1, 
of which each element, ij, is the sum of the coefficients in the li-rows for 
column Jc, These elements are 

9 

( 1 ) tk = 

U-1 
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where r«it represents the correlation coeflicients in the selected rows. The 
augmented matrix is now of order (n-f 1) by n. It should be noted that the 
rank of the matrix is unaltered because the new rtjw i.s a linear combination 
of the rows of the given matrix ryt. 

Next we augment the matrix by a column, ns shown in the figure. Each 
element t,- of the new column is the .sum of the coeflicieiit.s in the v columns 
of the row j. These elements are 

a 

( 2 ) I 

C=al 

where represents the correlation coefficients in the .selected columns. 
The augmented matrix is now a square matrix of order (?i-l-l). Its rank is 
still unaltered because the new column is a linear combination of the col¬ 
umns of the previous matrix. 

The diagonal entry at the intersection of the new cf)liimn and the new 
row is denoted T. Let and denote the suin.s tj and /* in the rows and 
columns of the .selected group. Then T can be wriUen 


(3) r = 

ll~l 

because the transpose of the row is the (.‘oliimn {,■. 
Let a multiplying factor be defined by 



Then a new matrix may be written as in Figure 2, which contains the square 
matrix ryi with a new row o* and a new nolumn oy and their interaection. 
The entries, a, in the new row are determined by the relation 

a* = mik, 

and the diagonal entry then becomes Vt. The entries in the column ay are 
determined by the relation 

ffly = m(/, 

after which the diagonal entry becomes 1. The rank of the matrix is un¬ 
affected by the application of the stretching factor m. The column Oy is 
the transpose of the row at, since Oy=a* when j = 

column can now be regarded as showing the projec- 
lons o era tests of the matrix ry* on a unit reference vector 7, as shown in 
figure 2. The entries ay can therefore be taken as the first column of the 
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factor matrix. A table of first-factor residuals is then prepared, and a new 
group of relatively well-correlated tests selected for a repetition of the same 
process. This procedure is continued until the residuals disappear or be¬ 
come small enough to be ignored. 

As a numerical example for factoring we shall take the correlation matrix 
of Figure 1 in chapter Hi, That matrix is reproduced here in Table 2. We 
select a test that has the largest number of relatively high coefficients. 
Such is No. 7, which has three coefficients of .60 or higher. We arrange the 


k. 1/ 



Fiqtjrb 2 


Tablet 
First Group 



coefficients for No. 7 in descending order by absolute value and tabulate the 
inter correlations of a group of tests as shown in Table 1. In this table are 
shown only the coefficients above .40. What is to be regarded as a high 
coefficient depends on the order of magnitude of the coeflB.cients in the whole 
table. The grouping method does not give a unique solution, and there is 
no absolute rule for determining the size of the group of tests to be used for 
computing each successive column of the factor matrix. In Table 1 we se¬ 
lected three tests to constitute the first group, namely, 7, 8, and 3. We 
might have included test 6. 

The three teats selected to constitute the first group are marked in col¬ 
umns and rows of Table 2. The summations tk are shown for each column. 
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as well as the sum T. Applying the multiplying factor m, we have the bot¬ 
tom row of the table, which shows the first-factor loadings. These are copied 
as the first column of the factor matrix in Table, 6. 

In Table 4 are shown the first-factor residuals. These are (rj-t-ayiati). 
These entries are obtained by .subtracting elements of Tabic .“J from the 
corresponding elements of Table 2. 

TabU 2 


Correlation Matrix 





X 




X 

X 


1 

2 

3 


5 

0 

7 

8 

1 

.58 

.63 

.46 

.51 

.35 

.18 

.45 

.24 

2 

.63 

.81 

.36 

.54 

.45 

.00 

.27 

.00 

X 3 

.46 

.36 

.52 

.42 

.20 

.36 

.60 

.48 

4 

,51 

.54 

.42 

.45 

.30 

.18 

.42 

.24 

5 

.35 

.45 

.20 

.30 

.26 

.00 

.15 

.00 

6 

.18 

.00 

.36 

.18 

.00 

.36 

.48 

.48 

X 7 

.46 

.27 

.00 

.42 

.15 

.48 

.73 

.04 

X 8 

« 1 

.24 

.00 

.48 

.24 

.00 

.48 

.04 

.04 

t 

1.15 

.63 

1.60 

1.08 

.35 

1.32 

1.07 

1.70 

I 

.498 

.273 

.603 

.408 

. 1.62 


, 8.53 

.702 


Table 3 

b'irat-Facior Prodiicta 



1 

2 

3 

i 

G 

a 

7 

8 

1 

.248 

.136 

.345 

.233 

.076 

. 28.5 

.425 

.379 

2 

.136 

.075 

.189 

.128 

.041 

. 1.56 

.233 

.208 

3 

.345 

.189 

.480 

,324 

.105 

.390 

.591 

. .528 

4 

.233 

.128 

.324 

.219 

.071 

.268 

.399 

. 3.57 

5 

.076 

.041 

.105 

.071 

.023 

.087 

.130 

.116 

6 

.285 

.166 

.396 

.268 

.087 

.327 

.488 

.430 

7 

.425 

.233 

.591 

.399 

.130 

.488 

.728 

. 6.50 

8 

.379 

.208 

.628 

.357 

, .116 

.430 

. 0.50 

.581 


In order to compute second-factor loadings, a column i.s chosen which 
has a relatively large number of the higher cfocllicients. Test ‘2 is ,so selected, 
and its coefficients are arranged in dnsceuding order t)f ahsolulci values in 
the first column of Table The lower coefficients arc ignor(id. The inter- 
correlations are recorded as shown. Te.st 8 has a negative corrclat-ion with 
teat 2, so that teat 8 is recorded here with negative sign (—8). The correla¬ 
tion between tests (-1-2) and (—8) is +.208. A .similar interpretation applies 
to the other coefficients in this table. A group of tests i.s to be selected in 
which the signs of the intercorrelations within the group are all positive. 
According to this criterion, all the tests in Table 5 covdd be included in the 
group, with testa 6 and 8 taken as negative. The coefficients of several 
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teats are rather low, so we retain, only four tests for the second group, name¬ 
ly 2, 1, 4, 5. These are marked in rows and columns of Table 4. 

The row is determined by summation of four coefficients in each col¬ 
umn, and the value of T is computed as shown. Applying the multiplying 
factor m, we obtain the second-factor loadings in the bottom row, II. These 
are copied as the second column of the factor matrix of Table 6. 


Table 4 

Firei-Wador Residuals 



X 

X 


X 

X 





1 

2 

a 

4 

5 

6 

7 

8 

X 1 

.332 

.494 

.115 

.277 

.274 

-.105 

.025 

-.139 

X2 

.404 

.736 

.171 

.412 

.409 

-.156 

.037 

-.208 

3 

.116 

.171 

.040 

.096 

.095 

-.036 

.009 

-.048 

X 4 

.277 

.412 

.096 

.231 

.229 

-.088 

.021 

-.117 

X 5 

.274 

.409 

.095 

.229 

.227 

-.087 

.020 

-.116 

6 

-.105 

-.156 

-.036 

-.088 

-.087 

.033 

-.008 

.044 

7 

.025 

.037 

.009 

.021 

.020 

-.008 

.002 

-.010 

8 

-.139 

-.208 

-.048 

-.117 

-.116 

.044 

-.010 

.059 

i 

1.377 

2.050 

.477 

1.149 

1.139 

-.436 

.103 

-.580 ! 

II 

.576 

.858 

.200 

.481 

.476 

-.182 

.043 

-.243 


Tabu 5 


Second Group 



+2 

+1 

+4 

+e 

-8 

+3 

-6 

+2 

.735 







+1 

.494 

.332 






+4 

.412 

.277 

.231 





+5 

.409 

.274 

.229 

.227 




-8 

.208 

.139 

.117 

.116 

.069 



+3 

.171 

.115 

.096 

.095 

.048 

.040 


-6 

.156 

.105 

.088 

.087 

.044 

.086 

.033 


Table 6 
Factor Matrix 



I 

II 

1 

.498 

.576 

2 

.273 

.858 

3 

.693 

.200 

4 

.468 

.481 

5 

.152 

.476 

6 

.672 

-.182 

7 

.853 

.043 

8 

.762 

-.243 


3 "3 
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When the second-factor products (anati) are subtracted from the first- 
factor residuals in Table 4, it is found that the second-factor residuals all 
vanish. The reason for this is that the given matrix of Table 2 is of rank 2. 
The grouping method is exact in the sense that if the given correlation 
matrix is of rank r, then the extraction of r factors by this method will give 
residuals that all vanish identically. This is also true of the centroid meth¬ 
od to be described later. 

In Figure 8 we have plotted the factor loadings of Table O'. The configura¬ 
tion here is the same as that of Figure lain chapter Hi. The apparent dif- 

I 



ference is due to the interchange of abscissae and ordinates. This is asso¬ 
ciated with the fact that in multiple-factor analysis there is no distinction 
between independent and dependent variables. The arrangement of the 
columns in the factor matrix is of no significance, and, in plotting two- 
dimensional sections of a configuration, it is of no conscriuonco whether 
any particular factor is plotted as abscissa or as ordinate. An orthogonal 
transformation of order 2 can be written, os previously described, by which 
Table 6 is carried back to the factor matrix of Figure lb in chapter Hi. 

The grouping method has been used on large factor studies. It is com¬ 
parable with the centroid method, Each has certain advantages that will 
be discussed in a later chapter. The check rows and coliunns were omitted 
from the present chapter in order that the principles of the method might 
be described without the distractions of computational detail. 



CHAPTER VI 

FACTORS AS EXPLANATORY CONCEPTS 

Factor analysis was developed as a scientific method of investigating re¬ 
lated measurements that are not well understood. In order to illustrate the 
method we shall apply it to a problem in which the relations between the 
measurements are simple and well known. Instead of dealing with human 
beings and their test scores or other measurements, we Hhall consider a set 
of simple physical objects. In Table 1 we have listed twenty-seven cylin- 

TalU 1 


Twenly-teven Cylinders 


Cylin¬ 

der 

d 

1 

i 

Cylin¬ 

der 

d 

1 

« 

Cylin¬ 

der 

d 

t 

1 

1 

1 

2 

1 

10 

1 

2 

2 

10 

1 

2 

3 

2 

2 

2 

1 

11 

2 

2 

2 

20 

2 

2 

3 

3 

3 

2 

1 

12 

3 

2 

2 

21 

3 

2 

3 

4 

1 

3 

1 

13 

1 

3 

2 

22 

1 

3 

3 

5 

2 

3 

1 

14 

2 

3 

2 

23 

2 

3 

3 

6 

3 

3 

1 

15 

3 

3 

2 

24 

3 

3 

3 

7 

1 

4 

1 

16 

1 

4 

2 

25 

1 

4 

3 

8 

2 

4 

1 

17 

2 

4 

2 

26 

2 

4 

3 

9 

3 

4 

1 

18 

3 

4 

2 

27 

3 

4 

3 


ders. The shape of each cylinder is completely determined by two parame¬ 
ters, namely, the diameter d and the length 1. For each cylinder is also 
listed the specific gravity s. 

With these given measures we can compute for each cylinder the follow¬ 
ing seven measures: 


1) diameter d , 

Trd* 

0 = -T- : 

2) length 1 

4 ' 

3) base area a, 

Jl 

4) side area c, 

wdH, 

6 volume «, 

" 4 ’ 

6) diagonal t , 

t=Vd!‘ + P 

7) weights. 

w = av. 


The computed values of these measures were correlated. The result is 
shown in the correlation matrix of Table 2 for the seven measures on the 
population of twenty-seven cylindera. The diagonal entries were computed 
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as the best-fitting values for rank 2 by methods to be described in later 
chapters. The correlation matrix of Table 3 will now be regarded as the 
starting-point for a factor analysis in which we .shall try to e.vtract as much 
information as possible about these seven measure’s Holehj from the inter- 
correlations. 

We shall consider this problem as if the actual cylinders were available, 
each one identified by its number and by its seven scor{>.s. Rut we shall as¬ 
sume that we know nothing about how each of the mcasiirement.s was taken 
and that we know nothing about how the measurements happen to be cor¬ 
related. For the purposes of this illustrative example, this situation corre¬ 
sponds to that in which each member of an c-xporimental population is 
available and is identified as to his several test score.s or other measurements 
but in which we do not understand what the mca.snrements mean or why 
the measurements happen to be correlated. 


TaMe 2 

Correlation Afatrix 



1 

a 

.1 

4 

r> 

n 

7 

1 

.078 

.000 

.090 

.812 

.805 

. 5.50 

.746 

2 

.000 

1.000 

.000 

.541 

.348 

.823 

. 21 K ) 

3 

.900 

.000 

.087 

.803 

.( K )5 

.. 5.58 

.751 

4 

.812 

.641 

.803 

.968 

.909 

. 87 'l 

.807 

s 

.895 

.348 

.905 

.960 

.002 

.767 

.834 

6 

.556 

.823 

.rm 

.874 

.707 

. 1)68 

. 03 !) 

7 

.746 

.290 

. 7.54 

.807 

.834 

. 031 ) 

.072 


Before starting the factoring, we inspect tho intcrcorrclatioiis that have 
been given to us for analysis. Perhaps the first thing to be. noticed is that 
all the intercorrelations in this problem are positive or zero. This means 
that the configuration of test vectors does not spread over mon' than a 
right angle and that all the test vectors are contained within a cone of 45“ 
generating angle. This is also the situation actiially fouml experimentally 
with tests of the cognitive functions. 

Inspection of tho diagonal cells shows remarkably high connuunalities 
except for variable No. 7, whose coramunality i.s .(>72. In most experimental 
studies one does not find comm\inaUtics of .9(5 and highc;r unless the domain 
has been explored so eomplctely that most of the vuriaucc, of ea<'h test is 
fairly well known. Variablo 7, whose commiinality is .(572, has only two- 
thirds of its variance in common with the other test.s of this battery. Hence 
one-third of its variance is unique. In, this example it is easily seen why 
this should happen; but, in factorial studies generally, the nature of unique 
variance is usually unknown. Variable 7 is the weight of the cylinder, which 
is determined by the volume and the specific gravity. The volume is a func¬ 
tion of diameter d and length I, and hence the variance in this characteristic 
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is shared with the other measurements, which are also functions of d and 1. 
But the specific gravity s enters into only one variable of the battery, 
namely, the weight w, and hence the individual differences among the cylin¬ 
ders as regards specific gravity produce unique variance in w. That part 
of the variance of w which is due to volume is common-factor variance, 
while that part of the variance of w which is due to specific gravity is unique 
variance. The common-factor variance of w is its communality, while the 
unique variance is the complement of the communality. 

The correlation matrix of Table 2 was factored by the grouping method 
that was described in chapter v. Teats 1, 3,4, 5, were used for the first group, 
and tests —1, +2, —3, -t-4, d-5,-f 6, were used for the second factor. The 
resulting factor matrix is shown in Table 3, a, This factor matrix was plotted 
in Figure 1, with the orthogonal axes I and II as shown. 

Table S 

Factor Matrices 



a 



5 



0 



I 

II 



At 


Si 

s, 

1 

.960 

-.234 

1 

.989 

.000 

1 

.821 

-.661 

2 

.232 

.972 

2 

.000 

1.000 

2 

.654 

.835 

3 

.963 

-.238 

3 

.992 

-.004 

3 

.822 

-.556 

4 

.928 

.341 

4 

.821 

.551 

4 

.089 

.000 

S 

.975 

.132 

5 

.916 

.359 

6 

.961 

-.213 

6 

.720 

.643 

6 

.647 

.796 

6 

.898 

.365 

7 

.821 

.119 

7 

.770 

.310 

7 

.812 

-.172 


With the factoring completed, we have before us the factor matrix of 
Table 3, a, and the configuration of Figure 1. We also have the twenty-seven 
cylinders, each identified with its seven measures or scores; but we have, 
supposedly, no knowledge of what the measurements mean. In this simple 
geometrical example we hope to show the fundamental nature of factorial 
analysis as a scientific method. If the principles can be seen in a simple case 
in which the underlying relations are definite and weU known, perhaps the 
application of the method to more complex problems can be undertaken 
with more confidence and with a better understanding of its possibilities 
and limitations. 

It has been shown that the location of the reference frame I-II that is 
obtained in factoring is essentially arbitrary. Its location in the configura¬ 
tion depends on the method of factoring. In the present case the axes I 
and II were determined when the successive groups of tests were chosen. 
The method of choosing the groups is not unique. Hence we should not be 
misled in assuming some simple physical interpretation of factors I and II. 
They may have physical meaning if each group constitutes a cluster with 
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some trait in common. In the present case there is no definite claster »himt 
axis I, and there is no cluster at all near axis II, 

The seven test vectors in Figure 1 spread in a fan from tests 1 and 3 to 
test 2, with the other test vectors between them. It can seen by m.spec- 
tion that the fan covers a right angle. This fact is os-socialed with the fact 
that test 2 correlates zero with 1 and 3 as shown in Table 3. Teats 1 ami 3 
are practically colUnear, and this is associated with the fm-t that their corre¬ 
lation is practically unity. 

One alternative is to locate the reference frame at A i and A j Ijc-cause this 
orthogonal pair of reference vectors incloses the whole configuration. If 
we put the reference frame in this position, the factor loadings will lie all 
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positive or zero, os shown in the factor matrix of Table 3, b. A factor matrix 
of this type and of rank 2 is associated with the fact that all the intercorre- 
lationa are positive or zero. The extension of this relation to 3 and higher 
dimensions will be discussed later. An interpretation can often be found 
for factors, such as Ai and At, which inclose a whole configuration. 

Another alternative location of the reference frame is to put the first 
axis in the middle of the configuration. Such an axis can be located in the 
middle of the span between Ai and At, or it can be so located that it will 
pass through the centroid of all the test-vector termini, or it can be located 
so as to maximize the sum of the squares of the projections of the test vec¬ 
tors on the axis. The two latter methods would give nearly the same factor 
axis in Figure 1. As an example of the location of a first axis in the middle 
of the configuration, we have drawn the factor axis Bi through test 4. The 
resulting factor loadings are shown in the first column of TabZe 3, c. It will 
be seen that the factor loadings are all positive and of appreciable magni¬ 
tude. A common, factor which has appreciable loadings on all the tests in a 
battery is called a general factor for that battery. Strictly speaking, a general 
factor might be one that has non-vanishing loadings in all tests, even 
though some are positive and some negative. But, as the term is ordinarily 
used, a general factor is one that has appreciable positive loadings in all 
teats of a battery. In the present problem the location of a general-factor 
axis is not unique because it can be moved over a considerable range and 
still give appreciable positive loadings for all tests. If a general-factor axis 
Bi is placed somewhere in the middle of the configuration, the second or¬ 
thogonal factor axis Bt can be placed as shown or in the opposite direction. 
One of these directions is chosen as positive i+Bt) and the other m n^a^ 
tive (- Ri). The same could have been done for the first axis—if there had 
been any test vectors with negative projections. The factor loadings on Bt 
are shown in Table 3, c. It will be seen that some tests have positive load¬ 
ings and that some tests have negative loadings on the factor B®. A factor 
which has both positive and negative saturations is called a . 

It should also be noted that whenever a factor axis is placed in the mime 
of a configuration, then each of the subsequent factors in the analymsmU be 
bipolar factors. This theorem is clearly seen in the configuration of Figure 1, 
and it is true for a test configuration in any number of dimensions or facr 
tors. Since this relation follows as a geometrical necessity from the location 
of the first axis in the middle of the configuration of test vectors, we should 
be cautious in attempting to impose a physical interpretation on the bi¬ 
polarity of factors. This type of bipolarity may have Physical sipifioMce, 
but it may also be merely a geometric consequence of the location of the 
first axis in the middle of the test configuration, ,. , , ft 

We have considered several of the principles by a- 
ence factors con be located in the configuration. We shall now proceed to 
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t to illustratu the niimiuu’ in wliich one 

analyze two of these 

attempts to find ““ , v ^ unit vectors, A i anti yl s- Ivich of 

The frame AxA. is veu-tor for a porfoH test of a 

these unit vectors may be unit (■oiiimiinality. The ftu-tor Ai is of a 

factor. Such a test would hav ;,,l-.,.porrehitions of iiifiisurcs 7 iuitl ;/ 
that™ n,a 
completely, since these variaiifo of test 2, siniT! Hit; fatittir 

The factor Ai involved in the varianen of all Hit; nica.surt‘s 

loading IS ® 2 but it is rcpre-scnled in alnio.st pure 

to an appreciable extent except ^o. out, u. i 

form in tests 1 and 3. me-isures that art; involved, we turn tti 

If we know fo.- H..; faelor that would 

them to see if in Uie faelor anti wliieh would 

S in tests that are low in the factor. In p.syt..hologifal wt.rk one 

:^^metimes make a 

This is the ineHitid that has been usetl ftir 
wo htive u.. hn.,wle.l.i^ 

the natural the measurements. This is even more t.f a haiitlieap Hi. ii wc 
ordinarily have in factorial studies, becau.se oxiionnieutal ineasureiuenl.s aie 
usuZbaseron some knowledge of their implications, tiven ,f heir under¬ 
lying wder is not understood. If we arrange the mnt; difterent cyhndut al 
fm-ms in order, from the lowest to the Inghast m acconlance with fat o . , 
we have the arrangement shown in Figure 2. 1 ln.s arrangement i w t .its that 
the factor is associated with the thickness t.f the eylmder.s. an. we mi^ 
call it the “thickness” factor. The diameter (7) ami the ^ 

area {S) are both determined by this factor, as is shown by the fact that 
these two measurements have no projection on the only other eonimon fat - 
tor in this battery. The fact that the conununalities are near uinly imeals 
that there is hardly any residual or unitiuc variance left in the.se t wt. meius- 

urements after the factor A 1 has been detennineil. 

We proceed next in the same manner with the factor A s by arrtingnig Uic 
nine different cylindrical forms in order, as shttwn in I he tigiire. lluw! 
cylinders are evidently arrangctl in the orthu- of their heighl., and we iiiig i 
therefore call this the "height” factor. This fact.ir is invt.lvtsl in all the 
measures except 1 and 3. It should be noted that, when we name these fac¬ 
tors either by examining the nature of the mcuaurenienls in .soine way or by 
ovamiTiing the individual members of the experimental ptipulation, we have 
only a hypothesis concerning the nature of the factor. Sometimes two oi 
more hypotheses appear to be equally plausible for the intcrp'etatitiu of a 
factor. Then a new factorial experiment should be set up, with additional 
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measurements so selected that they represent the two hypotheses with the 
least possible overlapping. The resulting factorial experiment might sustain 
one of the hypotheses, or it might show that neither of the hjTJotheses is 
correct. In the present case we have identified one factor that is associated 
with thickness. It has two scores or measurements completely determined 
by this factor, namely, 1 and 3 (diameter and base area). Another factor is 
associated with the height of the cylinder. Wo have found that all the 
measurements involve these two parameters or factors and that only one 
of the measurements (7) involves some additional factor. 

We turn next to the alternative reference frame represented by the unit 
reference vectors. Si and Bj. The factor Bi was placed so as to be collineax 


nDUDUnDUn Thickness factor 


aanDDD 


Tallness factor 



□ □□ 

□ □□dD- 

short-thick short-thin and tall-thick tall-thin 


Size foctor 


Bipolar factor 
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with the teat vector 4, which is in the middle of the range of t^t vectors. 
All the factor loadings are positive and of appreciable magnitude, so that 
this is a general factor. In Figure 3 we have the nine cyhntocd forms ar¬ 
ranged in order according to this factor, from the lowest to the highest. In¬ 
spection reveals that the cylinders are arranged m order of size, irrespective 

of shape. We might call this characteristic a "general-Bize factor. It can be 
seen in the figure that the cylinders are in order according to longitu^nal- 
section area. This happens to be proportional to the measure actu^y taken 
for the factor Bi, namely, the side area. We might choose a naghbormg 
vector as an index of size, such as the volume vector 6. The location of this 

factor in the configuration is not unique. ,. , ., . r j i 

We turn next to the factor B,, according to which the mne cylmdric^ 
forms were arranged in the last row of Figure 3. The plot of A-jure 1 reveals 



MULTIPLE-FACTOR ANALYSIS 


such as a “slenderness distribution, where the 

to short and thick cyhn ers. ,.yliuders 

factor loadings are near zer , .. , jj tliose that can be 

which are neither frscriptions, “short-thin” 

StteTwi JL positive seturation on the mo factor. For eomo 

STth* o"^' SC°alietch L “ 

darree of slendemeas; but for most purposes this claasihcation would prob 

Susti:t^.t “ should piobably hud the simplest 
exolanltory concepts to be represented by fa.!torial axes hat border ..r in- 
i rionfiguration rather than those in which a donmmnt factor .s im 
average of all the measures of the battery by going through the nnddle of the 
configuration. As far as adequacy of description is concomed, any i-cfeicnce 
frame might be used which can gain acceptance as to the interpretation of 
the factors. All three of the frames that have been discussed here are equal- 

Iv accurate in the description of the correlation eoefiicicuta. . 

^ We have seen that the reference frame that is found m the fuctaiing is 
ordinarily arbitrary. We have considered two alternative 
reference factors, both of which can be given some physical mtw pi datioii. 
The location of a meaningful reference frame is not unique, but tlicie some 
times exists a preferred reference frame that is more readily mterpretc 
than the others. In the nature of the case one cannot prove that the frame 
chosen is in any sense the correct one. Nor can one demonstrate that some 
other frame would not also be meaningful. The best that one can do is to 
discover a set of reference factors that can be given plausible interpretation 
to aid in understanding the underlying order among the vanabhis in tlie 
battery. Such findings can be followed by other experiments in the explom- 
tion of the factors that are revealed by the factorial analysis. It should be 
recognized that a factorial study is successful to the extent that meaningful 
factors can be identified by a proper choice of reference axes. 



CHAPTER VII 
THE SPHERICAL MODEL 

The vector model 

In previous chapters we have considered factor problems in two dimen¬ 
sions. The same concepts will now be extended to problems of three common 
factors. The correlation matrix can be represented by a set of vectors whose 
scalar products are the correlation coefficients. If the rank of the correla¬ 
tion matrix is 3, then there must be postulated three common factors. The 
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figuration would be produced if wo were to write a correlation juatrix at 
random with positive or zero coefficients and subject to tlie restriction that 
it be of rank 3 to correspond with the three dinuinsiuns of the inodi'l In 
Figure 2 we have a configuration of tet voctora showing t lircts clusl crs. Tlio 
tests within a cluster would have high intercorrelations, while pairs of tests 
from different clustei-s would have low correlations. If the throe clusters 
were at right angles, the tests from different clusters would, have correla¬ 
tions of zero or near zero. If such a configuration were found, it would be 
natural to suspect that the tests represented three different kinds of traits 
which are statistically independent. The clusters would be apparent by in¬ 
spection of the correlation matrix because the tests could be so grouped 
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that the tests within a given group would be highly correlated, while tests 
from different groups would show low correlations. 

Figure S show.s a different type of configuration, in that the test vectors 
are arranged in three planes. The configuration could be described as a 
three-sided cone with te.st vectors in each side of the cone and with apex at 
the center of the cork. If such a configuration of test vectors were found, it 
would be natural to .suspect that three parameters or factors had detemined 
the correlations and that the parameters could be represented in the simplest 
way at the corners of the configuration. Each test vector that lies in one of 
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^ X i +n unit lenirth. The termini of the vectors can 
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we should find that the configuration of a test battery looked like /■ ig- 
ure 6, then the simplest description of the test vector., would be .« terms of 



FtoimB 4 

the vectors A, B, and C at the cornora of the configuration. All the U‘.sls on 
the side AB could be described in tenn.s of the two v(ictor.s A and B; the 
teat vectors on the side BC could be described in terms of the vector., li and 
C; and similarly for the test vectors on the side AC in terms of the vtHJtors 
A and C. We should then make the hypothesis that the vectors A, B, and C 
at the corners of the configuration represent underlying properties or sim¬ 
plifying parameters in terms of which the correlations of the whole test bat¬ 
tery can be understood. A test vector near the middle of tho side A 23 would 
then be described as a linear combination of A and B with equal weights 
for A and B. A test vector near A on the aide AB would also be described 
as a linear combination of A and B, but the weight would be relatively larger 
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. J 11 .V f«r B In a configuration of this kind each test vector 

wi’Tribed in te^ms of less than three factors, even though the bat- 
could be described in This is the principal characteristic 
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tain only the common factor A or the common factor C. The tests near B 
contain only one of the three common factors, namely, B. Furthermore, we 
see that all the teats in the batteiy have some saturation on the factor B 
because the tests on the side AB are linear combinations of A and B, while 
the teats on the side BC are linear combinations of /f and C. Hence the 
factor B would here be a general common factor whi(jh is prcseul in all the 
tests of the battery. In a configuration of this kind the location of the plane 
AC is indeterminate, and so are also the co-ordinate vector-s A and C as 
far as the configuration is concerned. The only vector that is here deter¬ 
minate is the general common factor B.* 

* This common factor must not be confused with the kind of general common factor 
that is sometimes obtained for a factor matrix by locating the factor in the center of the 
configuration as a whole. Such an axis will necessarily be inside the spherical triangle, 
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Plotting the spherical configuration 

In order to study a configuration of test vectora in three dimensions, it is 
useful to extend them to unit length so that the configuration can be easily 
plotted on the surface of a sphere. When that has been done, we can see the 
whole three-dimensional configuration, as shown in the examples of Figures 
B, 6, 7,10, and 11. The process of extending the test vectors to unit length 
will be called normalizing the teat oectors. 

In Tdlile 1 we have a given factor matrix of twenty measures or tests and 
three orthogonal factors, I, II, and III. The first step in normalizing the 
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Normaliiing of Teal Vectors 
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Matiiix 

F» 


-.736 

.180 

.637 

-.209 

.182 

.519 

-.452 

-.426 

.416 

-.341 

-.147 

.485 

-.725 

.246 

.501 

.2.57 

-.239 

-.720 

.112 

.536 


.1.38 
.656 
.500 
.443 
.508 
.152 
.269 1 
.320 1 
.299 1 
-.364 1 
.436 1 
-.093 1 
.109 
-.619 
.522 
.165 
-.083 
.166 
-.660 
.488 


.997497 

.994183 

.990252 

.997547 

.993328 

.996691 

1.004670 

1.001500 

1.001898 

1.007968 

1.001000 

1.004788 

.991161 

.978673 

.961977 

.984581 

.998599 

.967781 

.963224 

.983006 


1.002609 
1.005861 
1.009844 
1.002459 
1.006717 
1.004328 
.995691 
.998602 
.998106 
.992095 
•.999001 
.995235 
1.008918 
1.021792 
1.039526 
1.016660 
1.001403 
1.033292 
1.038180 
1.017288 


.661 

-.738 

.138 

.729 

.181 

-.660 

.672 

.542 

.506 

.871 

-.210 

-.444 

.840 

.183 

.511 

.840 

.521 

.153 

.852 

-.450 

-.268 

.847 

-.425 

.320 

.859 

.415 

-.298 

.873 

-.338 

-.351 

.888 

-.147 

.436 

.871 

.483 

-.093 

.673 

-.731 

.110 

.733 

.251 

-.632 

.659 

.521 

.543 

.951 

.261 

.168 

.967 

-.239 

-.083 

.646 

-.744 

.172 

.729 

.116 

-.676 

.675 

.545 

.496 


vectors is to determine the communalities h. as shown. 
vector h is then determined, as well as its reciprocal Uhi-dj, whic 
comes a multiplier for each row of the given factor matrix. The augmented 
factor loadings of the normaUzed factor matnx are shown J^t 
three columns of Table 1. The data are then ready to be plotted on a sphe - 

chapters. 
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Each projection Ain, is the cosine of the angle between the normalized test 
vector J and the rrference vector M. The relation between the given factor 
matrix F and the normalized factor matrix F n can be stated formally in the 
matrix equation 

(1) DF = Fn, 

where D is a diagonal matrix with the stretching factor dj, or, by the ele¬ 
ments, 

(2) dflim “ A,‘in • 

Before plotting the spherical configuration, we first draw on the sphere 
three mutually orthogonal great circles. If the sphere is to be used repeated¬ 



ly for factorial problems, it is best to paint or scratch the three great circles, 
so that they will not be erased for each problem. One of the octants is 
chosen as positive for all three co-ordinate axes 1, II, III, as shown in 
Figure 10, and the three co-ordinate axes are labeled. 

In plotting the test vector termini on the surface of the sphere it is con¬ 
venient to use a strip of paper of length about twice the diameter of the 
sphere. On this strip are marked the surface distances corresponding to the 
cosines A]m. In Figure 8 wo have represented the strip S, which has also 
been drawn in Figure 9. The point 1,00 on the scale is placed at the refer¬ 
ence axis I on the sphere. The point on the scale at axis 11 is marked zero. 
The surface distance from 1 to II is then 


( 3 ) 


^ = 0.7584 d = i. 
4 
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The intermediate points on the scale are labeled directly in terms of the 
corresponding cosines, which are the entries in the normalized factor ma¬ 
trix Fn- For the projection Aji in F„ we have the corresponding angle 

(4) = coa“‘Aji 

and the corresponding surface distance 


(5) 


pt = 


t C08“‘Aii 

90 


For any given sphere the scale will be proportional to that of Figure 9. The 
measuring strip should be made twice as long as the scale indicated in Fig- 
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ure 9, so that measurements can be made of both positive and negative 

cosines. , 

In locating the terminus of a teat vector on the sphere, we find a point 
which has the required surface distances from the three orthogonal axes. 
The third measurement checks the location inferred from the first two 

Tables 

Valuee of p/or Given Values of Aj,„ = cos 


a 

# 

a 

# 

a 


a 

P 

a 

P 

1.00 

.99 

.98 

.97 

.96 

.00 

.09 

.13 

.16 

.18 

.96 

.90 

.86 

.80 

.76 

.20 

.29 

.35 

.41 

.46 

.70 

.66 

.60 

.56 

.50 

.61 

.66 

.59 

.63 

.67 

.46 

.40 

.36 

.30 

.25 

.70 

.74 

.77 

.81 

.84 

.20 

.15 

.10 

.05 

.00 

.87 

.90 

.94 

.97 

1.00 


measurements. When the scale has been prepared on a strip of Paper jr 
cardboard, any three-dimensional configuration is readify plotted on the 
sphere, so that the whole configuration can be seen directly. 

In Tahh S we have listed the values of p for different given values of the 
normalized factor loadings Ay„. These values of p can be used for making a 

scale to fit a sphere of any given diameter d- 

The present battery of twenty measures or tests has been on the 

sphere of Figure 10. Each point has been numbered to jd^yjh® 
spending teat vector. The three great circles are micated, “ 
three co-ordinate axes I, IJ, and III. Inspection of the configuration on the 
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sphere shows that the points are arranged in tlic form of a triangle and that 
all but two of the test vectors lie in the sides of the spheiital tiianglc. In¬ 
stead of using the arbitrary reference frame I, Hi HI, which was obtained 
by the factoring method, we draw a new reference frame,, as shown in fig¬ 
ure 11. By using these new reference axes, wo should be able to describe 
each of the test vectors that lie in the sides of the spherical triangle in terms 
of one or two reference axes instead of three, as rciiuiitHl in the fiainc of 
Figure 10. The three great circles are so drawn as to pass through or near 
groups of vectors, as shown in Figure 11. The new reference vectors are the 
normals to the three great circles, and the primary facdors aic determined 
by the three intersections of the new great circles. 



Figurb 10 


With the model as shown in Figure 11 we arc ready to put the factorial 
solution into numerical form. Consider the great circle drawn through or 
near the points 19, 2 , I 4 , 9, 12, G, 20, 3, IS. By moans of the mcasuimg 
strip locate a point on the surface of the sphere which i.s orthogonal to this 
circle. It represents one of the unit reference veidors, which may lie denoted 
Ai. In the same manner locate the other two refcrciiice vectors orthogonal 
to the other two planes. One of the reference vectors is shown in Figure. 11, 
namely, Aj. 

By means of the measuring strip, measure the three direction cosines for 
each of the reference vectors and record them in columns of the transforma¬ 
tion matrix A, as shown in Table 3. In determining the direction cosines of 
a reference vector, measure its surface distance from each of the three orthog¬ 
onal axes 1,11, HI, on the sphere. In the first section of the table we have 
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the given factor matrix F, and in the last section we have the desired factor 
matrix V, which describes the twenty test vectors in terms of the three new 
reference vectors kp, where the subscript p refers to the new axes. When the 
measurements have been taken from the sphere, it is advisable to adjust 
them in tlie second or third decimal, so that the sum of their squares is 
equal to \mity. This step insures that each of the reference vectors is of 
unit length. 

When the transformation matrix A has been written as in Table S, we 
can carry out the matrix multiplication 

(6) Fk=V. 



FlQtTBE 11 

The entries in this matrix show the projection of each test vector on each 
of the three new reference vectors. The point 20, for example, is on or near 
two of the new co-ordinate planes, as shown in Figure 11, and hence it 
should have two factor loadings that are zero or near zero, as shown in 

Torhlc S, 

Tlic new reference vectors are not orthogonal. The cosines of their angu¬ 
lar separations can be determined by the measuring strip and recorded in 
the matrix C of Table 3. The numerical values of these cosines can also be 
determined without direct measurement by the equation 
(7) A'A = C , 

or, in terms of the elements, 

^8) “ Cpe I 
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where the subscripts p and q refer to the new axes. Tlie transformation 
matrix A is not an orthogonal matrix, because the three new reference vec¬ 
tors are not orthogonal. The columns are normalized to correspond to the 
fact that the reference vectors are unit vectors. The cross prodiuds of pairs 
of columns of the transformation matrix A give the c<).siiu!.s of their angular 
separations, as in equations (7) and (8). In an orthogonal matrix the.se co- 


TabU3 

The TroMSoTtnoiion Maltix A 


Given Faotor Matrix P Tramformailon A 


Test 

I 

11 

III 


1 

A * 

Ajf 

Aj 

1 

.650 

-.736 

.188 

I 

.483 

.466 

.470 

2 

.725 

.180 

-.056 

11 

-.834 

.264 

.560 

3 

.666 

.637 

.600 

III 

.207 

-.847 

.675 

4 

.869 

-.209 

-.443 





6 

.834 

.182 

.608 





6 

.836 

.610 

.162 





7 

.866 

-.462 

-.260 





8 

.848 

-.426 

.320 





0 

.861 

.416 

-.299 





10 1 

.880 

-.341 

-.364 





11 

.880 

-.147 

.436 





12 

.876 

.486 

-.093 





13 

.667 

-.726 

.109 





14 

.717 

.246 

-.619 





15 

.634 

.601 

.622 





10 

.036 

.257 

.166 





17 

.066 

-.239 

-.083 





18 

.626 

-.720 

.106 





10 

.702 

.112 

-.660 






.664 

.636 

.488 






Primary Veotore T 



.661 

-.736 

.144 

?> 

.718 

.109 

-.671 

.654 

.646 

.524 


notated Poctor Matrix V 


Test 

A. 

Ay 

A. 

1 

.900 

.003 

-.003 

2 

.025 

.930 

.005 

3 

.007 

.023 

.957 

4 

.470 

.727 

.000 

5 

.887 

.005 

.844 

6 

.012 

.303 

.794 

7 

.710 

.512 

-.025 

8 

. 8.50 

.016 

.384 

0 

-.Oil 

.760 

.444 

10 

.615 

.623 

-.008 

11 

.668 

.008 

.038 

12 

-.007 

.610 

.628 

13 

.056 

.034 

-.013 

14 

-.024 

.021 

,063 

IS 

.028 

-.019 

.937 

16 

.282 

.362 

.704 

17 

.044 

.460 

.273 

18 

.947 

-.032 

.008 

11 ) 

.072 

.900 

-.040 

20 

.004 

,032 

.048 


TK~ D 


T. 

.972 

0 

0 

T, 

0 

.051 

0 


0 

0 

.972 


Correlation of Primaries 


Ooelnee of Itefernne# Vectors 



Tv 

Tv 

T, 


A. 

A„ 

A* 

Tr 

1.000 

.220 

.106 


1.000 

- .213 

- .055 

Tv 

.229 

1.000 

.224 


- .213 

1.000 


T . 

.105 

.224 1.000 

Ax 

- .055 

- .206 

1.000 


TT' = R,. 


A'A = C' 
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sines are zero because such a transformation represents the rotation of a 
rigid orthogonal reference frame. 

The primary vectors which represent the three underlying factors or 
parameters in pure form are unit vectors at the corners of the configuration. 

A unit vector at the corner near the test vectors 3, IB, and 20 represents one 
of those primary factors. It is defined by the intersection of two of the co¬ 
ordinate planes. Let the primary teat vectors be denoted T^, Ty, and T,. 
The direction cosines of each of these unit vectors may be determined by 
the measuring strip and recorded in the rows of the faetor matrix, as shown 
in Table 3. Here we are treating the three primary vectors as if they were 
additions to the given factor matrix. If we had three perfect tests of these 
primaiy factors with no unique variance, they would appear in the factor 
matrix, as shown in the rows T *, T#, and T 

If we add the three primary vectors to the given factor matrix and carry 
out the transformation, 

(9) Fk = V, 

for the last three rows of the factor matrix, we have the corresponding 
equation, 

(10) TA = D, 

where the product must be a diagonal matrix, as shown in Table 3. By defi¬ 
nition each primary vector lies in two of the co-ordinate planes, and hence 
it must have zero projections on two of the reference axes. The result is a 
diagonal matrix. If the reference vectors were orthogonal, they would coin¬ 
cide with the primary vectors; but, when the reference vectors are oblique, 
as in the present cose, the product is a diagonal matrix, in which the diago¬ 
nal entries deviate from unity. The diagonal entries are, in fact, the cosines 
of the angles between the primaiy vectors T, and the corresponding refer¬ 
ence vectors Ap, as can be verified on the spherical model. 

The matrix T, which shows the direction cosines of the pnma^ vectors, 
can be determined from the transformation matrix A without direct meas¬ 
urement on the sphere. By (10) we have 


( 11 ) 


T = DA -'-. 


We find the inverse of the transformation matrix A and normalize the rows 
of that matrix. Normalizing the rows of A-^ is repesented m equation 

(11) by the premultiplication with the diagonal matrix D. The result is the 
matrix r, which shows the direction cosines of the prima^ vectors. 

The correlations between the primary factors can be determined by di¬ 
rect measurement on the surface of the sphere. The sa^e 
be determined from the transformation matnx A without direct measure- 
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„e„t. Just as th. correlattous batweeu tha tets ar« given by the fund.- 
mentEl factor theorem, 


( 12 ) 


PF' = R]k = R, 


m lot the last thiee rows of the factor matrla we also have the ron-es,»nKl- 
ing equation, 

(13) ■ 

Substituting (11) in (13), we obtain 

(14) = (DA-‘)(/>A->)' 


or 

(15) Rpa = L>(A'A)“‘/) . 

Bv this equation the correlations between the primary factors can be deter¬ 
mined. When the product (A'A)-‘ has been computed, the diaRonal matrix 
D is so written that the diagonal entric-s of the eorrelatiim matrix ifp, are 
unity, since the scalar product of a unit vector and its(>If is, of course, unity. 
The diagonal matrix in (15) is the same a.s the diagonal makix nliown >n 
in the lower section of the oblique factor matrix V. Each entry m I) is the 
cosine of the angle between a primary vector Tp and the corrasponding 

reference vector Ap. , x, i i 

For some purposes it is useful to designate explicitly the general ele¬ 
ments of the several matrices of Table 3. In the given orthogonal factor 
matrix we have the elements ay„, and in the transformation matri.x we have 
X„p, where the subscript p refers to primary factors. The product i.s 

(16) ®j'm ^inji “ ^Jp > 

where the elements vjp of V show the projections of the test vcctons j on the 
reference vectors Ap. The elements of the matrix T arc denoted ip„,. 1 he cor¬ 
relation matrix for the primary factors is denoted /f to disliiigui.sh it from 
the correlation matrix for the tests, which is written E,-*,, or simply R with¬ 
out subscript. Let the elements of (A'A)"‘ be deimted l/pt- diagonal 

elements are hpp. The diagonal elements of are,, then, dp, or 

1 

= VF ’ 

The present example has been discussed in detail for the three-dimension 
al case to show the relation between the computational work and the geo¬ 
metrical interpretation. In the interpretation of primary factors we inspect 
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each column of the oblique factor matrix V to discover, if possible, the na¬ 
ture of the trait which is present in the tests with significant factor loadings 
and absent in the tests with negligible loadings on the factor. There is no 
guarantee beforehand that a simple configuration like Figure 11 can be 
found in any given problem, and there is no guarantee that a clarifying de¬ 
scription of the factors can be obtfuned. That is determined by the intui¬ 
tions of the investigator in setting up his factorial experiments so that 
meaningful and significant results can be obtained. 

Correlated factors 

In the previous discussion, examples of both orthogonal and oblique ref¬ 
erence vectors have been given. A set of orthogonal reference vectors is a 
geometrical representation of factors which are uncorrelated, and corre¬ 
lated factors are .shown by an oblique reference frame. Among statisticians 
and psychologists there is a rather general belief that if human traits are to 
be accounted for by any kind of factora, then these factors must be uncorre¬ 
lated. This belief has its origin in the statistical and mathematical conven¬ 
ience of uncorrelated factors and also in our ignorance of the nature of the 
underlying structure of mental traits. The reason for using uncorrelated 
reference traits can be understood, but it cannot be justified. Height and 
weight are two useful measures of body size, even though they are corre¬ 
lated. If we should use, instead, two linear combinations of height and 
weight which are uncorrclated in the general population, we might find such 
measures more convenient in statistical theory, in that the cross products 
would vanish and we could find a certain satisfaction in that the two meas¬ 
ures are independent; but they would be awkward to think about. 

We might as well make use of the freedom of factor analysis as regards 
orthogonality by allowing the primary factors or parameters to be corre¬ 
lated. In the physical and biological sciences we have the exact counterpart 
of this situation. There we deal with parameters that usually have some 
physical meaning, such as momentum, acceleration, blood pressure, the 
liminal stimulus, and thousands of other parameters that have meaning in 
conceptual representation. Scientists seldom worry about the fact that 
parameters are correlated in a random group of people who might be the 
subjects in a scientific study, unless such covariance is itself the object of 
study in relation to underlying theory. If two parameters should be found 
to be nearly perfectly correlated, the fact would surely be noticed, and we 
would then try to reduce the corresponding concepts to an identity by re¬ 
formulating fundamental ideas about the phenomena. 

The restriction that parameters be uncorrelated appears only in those in¬ 
vestigations in which we start with no ideas. The correlation coefficient is 
a symbol of complete ignorance. It is rarely, if ever, used in those problems 
which are well understood. Let us take an example to show how unneces- 
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sarv it would be to insist on zero correlation between ptmuneters when the 
S onlare well understood. Let us suppose that nothing is known about 
Mure of rectangles except that we can take measvmnmud on them. 
We might measure five hundred rectangles and discover that there m a corre- 
E of +.70 between the lengths and the widths in our colhMdion of reo- 
tSes. Such a finding would be determined by the act that big m-tang es 
tend to have long sides and to be wider than small rectarigle.s. might 
have the conviction that the principal properties of reidanglea could be de¬ 
termined from their lengths and widths, but we shou d have to meet the 
restriction that the two parameters must be uncorrclated in the particular 
set of rectangles that we collected for measurement. 1 hat could be done if, 
for instance, we took the length as one measurement and, say (R -iL) as 
the other measurement, where L and W are the length and width, respective¬ 
ly. The linear combination would depend on the particular .sot of rectangles 
in the experiment. Two measures could easily be found which were imcor- 
related in our particular collection of rectangles, but the result would not 
be very useful in thinking about rectangles. As another example, in taking 
physical measurements of men, it is customary to record height ami weight. 
If we were forbidden to use these two measures because they arc correlated, 
the absurchty of such a restriction would be self-evident. ()n the other hand, 
it should be recognized that if we deal with a group of mciwuri>.s that are 
highly correlated, we are likely to be confining ouraclves to tme domain, and 
it is then useful to look for other significant measures that cover additional 
features of the things that are being measured. In general, measures that 
cover different aspects of an individual are likely to sliow lower correlation 
than those which represent the same domain; but it does not follow that 
our fundamental concepts should be in any sense restricted to tlioso which 
show zero correlation in a random group of people. In developing the fac¬ 
torial methods we have insisted that the methods must not impose ortho¬ 
gonality on the fundamental parameters that are chosen for factorial de¬ 
scription, even though the equations arc thereby simplified in that the ero® 
products vanish. In the methods that we have developed, each author is 
still,free to impose orthogonality on the factors if lie so choo.soH or if the 
nathre of his problem is such that this restriction is indicated. 


The box problem 

The box problem is an example involving three parameters or factors 
that are represented in the spherical model of Figure 11 * A physical ex- 

* The numerical problem that ie used in this chapter is the BO-called "box problem, 
which was designed to correct some current misconceptions about factor analysis. Sec¬ 
tions from the original publication of the box problem will be used here to illustrate by a 
physical example the interpretation of primary factors os simplifying parameters that 
are not necessarily unique (see "Current Issues in Factor Analysis," Psychological Sulle- 
tin, XXXVII, No. 4 [April, 1940], 189-230). 
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ample of two parameters or factors—^the cylinder problem—^was used in 
chapter vi, 

A random collection of boxes constitutes the population in this example. 
Let us imagine a collection of boxes and a set of twenty measurements for 
each box. Let u.s assume, as is really the case in most psychological problems, 
that we have no idea what these measurements represent and that we believe 
some underlying order may exist in the twenty measurements for each box. 
In this fictitious example the boxes constitute the individuals in a statistical 
population, and the measurements correspond to twenty test scores for each 
individual. In Table 4 we have the three dimensions, x, y, z, for each box. 

Table 4 


Baxu 

Dimenaiona 

X 

y 

1 

3 

2 

2 

3 

2 

3 

3 

3 

4 

3 

3 

5 

3 

3 

6 

4 

2 

7 

4 

2 

8 

4 

3 

0 

4 

3 

10 

4 

3 

11 

4 

4 

12 

4 

4 

13 

4 

4 

14 

5 

2 

15 

5 

2 

16 

5 

3 ‘ 

17 

5 

3 

IS 

6 

4 

19 

5 

4 

20 

6 

4 


1 

2 

1 

2 

3 

1 

2 

1 

2 

3 

1 

2 

3 

1 

2 

2 

3 

1 

2 

3 


The box population is here defined in terms of twenty different rectan^ 
box shapes, and it is assumed that these twenty shapra occur mth fre¬ 
quency in the population of boxes. For example, if the population coMute 
of two hundred boxes, there are ten of each kind. Any other arrangeme 
could have been taicen. In TdbU B we have a list of the twenty Jnea»jre- 
ments (tests) that were taken for each box. These measurem^te co^i^ of 
various non-linear functions of the three dimensions, x, y,z; “ the fa^r 

analysis the number of basic factors and their combination m the twenty 
measurements are assumed to be entirdy unknown. 

It will be seen in the formulae of TahU B that each of the f - 

represents the square of an edge of the box; 4, 6, and 6 ^ 

a dde; 7, 8, and 9 represent the diagonal of a side; 10.11, r^re 

the perimeter of a side; and the other tests are similar arbitrary functions 
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of the three box meiisuremenls. In acalhiK witli llu'. twcniy lucusurrmnnls 
for ea<-h box. we treat them nioiTly as if they were twenty test s.-ores for 
each box We correlate them luul factor them us if we knew nothinp: about 
the manner in which the scores became correlated. ()nr object i.s to discover 
by factor analysis whether or not the twenty measurements for each box 
reveal some underlying physical order. Actually, we l.avo set up tin; mcas- 
urements so that three factors arc involved- •namely, llu‘, three dimen.sioii.s 
of a box—but we deal with the problem faelorially as if we diil not even 
know how many factors were inv(.lved in the twenty test seore.s for each 


Table S 


Tesla 

X 

HlruttUin* 

y 



1 

+ 




2 


+ 


2/’ 

•A 



+ 

-a 

4 

- f - 

+ 


a-tf 

S 

+ 



xz 

C 


+ 

+ 

■>/•• 

7 

+■ 



V'j’ + i/a 

8 

-1- 


-1- 


9 



•h 

V 

10 

+ 

+ 


2x4-2;/ 

11 



+ 

2x+2; 

12 


+ 

H- 

2;/4-2: 

13 

+ 



loKX 

14 


+ 


!"K It 

15 



+ 

1"K ~ 

10 

- t - 

+ 

+ 

itUi 

17 


+ 

+ 

Vx’+;/’-K> 

18 

+ 




19 


+ 



20 



•f 



box. In order to simplify the problem, cm»rs of measurement and .sampling 
errors are here omitted. The correlations are, therefore. mialTeeteil by tlie 
number of multiples of the twenty diffcirent box shapes that const it\ilo the 
statistical box population. The correlations were determined from the box 
measurements listed in Table J^ and the test himmluc of Tnhlv In Tnbh' 3 
we have the centroid matrix for three faetors. The mean of l.lui absolute 
residuals (disregai'ding sign) after three faetors had heem (,'xt.raete.il was 
.008, which does not warrant the extroetiou of mores factors. At this point 
we would know that only three factora were involved in the twenty fictitious 
box scores. 

In the interpretation of the rotated factor matrix V of Table 3 we look for 
the tests which have the high saturations in the first column. The.se are 
tests 1, 13, and 18; and we conclude that the fir.st primary factor is very 
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heavily represented in these tests. In this fictitious problem we can actually 
turn back to Table to find the formulae for those tests in terms of the pi'i- 
mary factors. These are, of courae, not known in psychological problems. 
We find that tests 1, 13, and 18 are the only three tests which depend ex¬ 
clusively on the ^-dimension of the boxes. 

In the third column of the factor matrix V of Table S we find three tests 
with high saturations, namely, 3, 15, 20. These three tests are therefore 
judged to have most of their variance on one of the underlying factors. In 
Figure 11 we find these three tests at one corner of the configuration, and we 
conclude, therefore, that they involve only one of the three common factors, 
whatever they may be. Turning back to ToMe 5, as we can do in this ficti¬ 
tious example, we see that the three test scores are the only ones that are 
functions of the parameter z. 

Consider the bottom row of tests in Figure 11. These tests are 19, 2, 14, 
9, 12, 6, 20, 3, 15. Since these test vectors lie in one of the co-ordinate 
planes, we infer that there is one factor that is absent in all these tests and 
that the factor is conspicuous in 1, 13, and 18, which lie at the opposite 
corner of the configuration. Turning to Table 6, we see that this factor is x. 

The same kind of comparison can be made for each of the three primary 
factors X, y, and z. Those teats which depend on only one of the primaiy 
factors are in the corresponding corner of the diagram, and they are repre¬ 
sented in the factor matrix V with large factor loadings in the proper col¬ 
umn. Those tests which are functions of two primary factors are represented 
as points on the sides of the triangle, and the points are consistent through¬ 
out as to the pairs of primary factors involved. Finally, the two tests 16 and 
17, which have formulae containing all three of the primary factors, are in¬ 
side the triangle. They are the volume and the principal diagonal, respec¬ 
tively. It is interesting that the linear approximations which are assumed 
in factor analysis reveal a simple configuration, even though the twenty 
measurements were nonlinear functions of the primaries. The discrepancies 
are represented by the small entries in the factor matrix V, which would be 
zero if the factor methods did not depend on the assumption of linearity as 
a first approximation. 

Next we note that the three primary factors in this population of boxes 
are correlated. The correlations among the primary factors as determined 
by the factor analysis are shown in Tc^le 3. The actual correlations between 
the primaries in the original data are shown in Table 6, and the agreement is 
self-evident. In setting up this example we assumed that a random collec¬ 
tion of boxes would show correlation between the three dimensions. A box 
that is tall is likely to be thick and wide, probably to a greater extent than 
the correlations which we assumed in the fictitious problem. 

It would be possible to set up an example with twenty measurements 
so that every measurement would involve all three of the box dimensions. 
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A-factor analysis of such a system of measurements would not reveal a sim¬ 
ple structure, so that no clear bounding planes could be determined. In 
psychological experiments we must recognize this possibility. Some factor 
experiments will fail to reveal priraaiy factors. This will necessarily happen 
if each variable involves as many factors as there are factora in the whole 
set of variables. There is no guarantee beforehand that this will not happen. 
On the other hand, it is extremely unlikely that a simple structure will ap¬ 
pear with the same identifiable primaries in several independent factor anal¬ 
yses of different test batteries that are given to different populations, unless 
the structure is valid. 

The interpretation of the primary factors in the factor matrix V would 
consist in studying the several teat variables that show high saturation on 

Table e 


Correlalion Matrix 



X y z 

1 

X 

1.00 

Y 

.26 1.00 

Z 

.10 .2.') 1.00 


each primary factor. One would try to find what it is that i.s common to 
these variables or measures. One might discover that, in general, tallness is 
a common characteristic of one primary and that the be.st measurements 
available for tallness are those which show highest saturation on the factor. 
We might name it a "tallness" factor. That would merely imply that the 
twenty measurements are functions of three linearly independent parameters 
and that one of them is tentatively named “tallne,sB.” A box which meas¬ 
ures higyi on that factor would stand higher from the floor than boxes that 
are low in that factor. Now this identification of the linearly independent 
parameters in the twenty box measurements would not imply that the tall¬ 
ness factor has some sort of locus in each box or that the factor is a separate 
organ or gadget in each box or that it is some sort of isolated, abstrac-t, sta¬ 
tistical box-element that has nothing in common with the rest of the box. 
It is an independent parameter that is involved in the box measurements. 
Exactly the same procedure is followed in dealing with psychological data. 
The identification of a primary factor in psychological test experiments is 
merely a challenge for us to find out what sort of process or attribute it is 
in terms of known concepts or else to invent new concepts that fit the ex¬ 
perimentally determined primary categories. 

The attempts to interpret the primary factors have often been criticized 
because they are not sufficiently objective. Let us be clear about two dis¬ 
tinct problems that are involved here. It is one problem to isolate a primary 
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factor and to determine by repeated experiments that it has some functional 
uniqueness. That is factor analysis proper. It is another problem to find 
the psychological or physiological meaning of a functional uniqueness when 
it has been determined. That is a matter of interpretation, and consequent¬ 
ly it is necessarily subject to debate, with conflicting interpretations. We 
must remember that the interpretation of every scientific experiment is sub¬ 
jective. There is no kind of scientific experiment in which the interpretation 
rolls out “objectively.” If there is such a factor as auditory imagery, for ex¬ 
ample, just how should the auditory character of the factor produce itself 
objectively in the statistical analysis and without the subjective interpreta¬ 
tion of the investigator? Or just how could tallness in the box population ap¬ 
pear objectively in the data? Factor analysis is no exception to other kinds 
of scientific experimentation. It is a fortunate circumstance, however, that 
different interpretations of a primary factor can usually be resolved as ques¬ 
tions of fact. New factorial experiments can be made to determine which 
interpretation is the more plausible. 

In naming the primary factors it is a better policy to name the factors in 
terms of well-known concepts, such as Number, Space, Verbal, and Memory 
factors than to name them in some noncommittal way, such as X\, Xa, and 
so on. If we name a factor “Number,” it will provoke experimentation with 
number tests and with nonnumerical tests, and the experiments are likely 
to be made in terms of psychological hypotheses that can be sustained or 
disproved experimentally. In this way we shall advance faster than if the 
primaiy factors are left as interesting statistical curiosities. They should be 
recognized as psychologically challenging experimental effects. We cannot 
expect to be correct in all interpretations of primary factors, and we shall 
probably have occasion to revise interpretations repeatedly as more experi¬ 
mental information becomes available. Again, this policy is consistent with 
the desire to make factor analysis a useful psychological tool instead of a 
mere statistical routine for condensing test scores and correlations. 

Those who criticize factor analysis as faculty psychology talk in the next 
breath about verbal and nonverbal intelligence, special aptitudes for music 
and for art, mechanical aptitudes, and disabilities in reading and arith¬ 
metic, without realizing that they are implying factor analysis and the inter¬ 
pretation of factors. Conversationally, we can talk about musical ability in 
the singular; but, as psychologists, we believe that different abilities are 
probably involved in a good voice, absolute pitch, originality in harmony, 
counterpoint, orchestration, melodic memory, ease in memorizing at the 
piano, ability in musical interpretation, and so on. How many important 
functional unities might there be in this domain? They are surely not all 
completely independent. They are correlated, and they probably represent 
a smaller number of abilities than the infinite number of musical tasks that 
could be given to a music student. To find these functional unities is the 
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problem of factor analysis. If that is faculty psychology, then .so is most in¬ 
vestigation of individual differences and most of the work on special apti¬ 
tudes and defects. And so also arc many of tlic (diaptcr leadings in the 
textbooks of psychology whicli the same critics are teaching. 

Correction for uniqueness 

The correlation between two experimentally obtained mua.s\irc.s is .some¬ 
times called a "fallible” coefficient in the sense that the correlation i.s some¬ 
what depressed by the experimental errors in the measur&s. If the two 
measures are the best available for two traits x and y and if it i.s desired to 
estimate the true correlation between the traits themselves Jis it would be 
expressed by perfect tests of the two traits, then the obtained or fallible co¬ 
efficient is corrected for attenuation. The correction for attenuation i.s an 
estimate of what the correlation between two tests would bn if the error 
variances were eliminated. The estimate is made in terms of exp(*rimcntally 
determined reliability coefficients for btitli tests. If a factor matrix i.s avail¬ 
able showing the loadings on common factors, specific factftr.s, and error 
factors, then the correction for attenuation (uin be obtained by eliminat¬ 
ing the error factor loadings and then normalising the remaining (iommon 
factors and specific factors for each tost, so that the*, sum of their Hq\iares 
is equal to unity. The correlation between two teats corro<'t(!d for attenua¬ 
tion would then be the cross product of their respective rows in the normal¬ 
ized factor matrix for common and specific factors. The same numerical re¬ 
sult is obtained by the usual formula for this correction, namely. 


(17) 


r' = 

* Xil 


where r'^y is the augmented coefficient, corrected for attenuation, and r^ 
and ryy are the reliability coefficients. 

The correction for uniqueneaa is analogous to the correction for attenua¬ 
tion. Instead of eliminating the error variance, we can imagine the tost so 
modified as to eliminate both error variance and specific variance. The re¬ 
sult would be a measure containing only the common factors normalized 
so that the sum of the squares of their loadings is unity. That is what Ta¬ 
ble 1 represents. The correlation between two tests as determined by the 
noiTualized common factor matrix is 


(18) 



Zfv. 

hxhy 


in which communalities are substituted for reliabilities. The correlations 
corrected for uniqueness are the scalar products of pairs of unit test vectors 
as represented on the spherical model. These corrections are useful in some 
theoretical problems, and they are represented in the illustrative problem 
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of this chapter by the cosines of the angles between the normalized test vec¬ 
tors. In the present case the principal interest is in studying the configura¬ 
tion of test vectors and not in estimating what the correlations would be if 
the tests were in any way altered. In studying the configuration of test 
vectors by the methods described here, it is best not to include in the con¬ 
figuration any tests whose communalities are small. Such test vectors are 
short, and, when they are much extended, their projected location on the 
surface of the sphere is unstable. If they are used in plotting the configura¬ 
tion, they should be specially marked so that less weight is given to them 
than to the test vectors which are not very much extended in normalizing. 



Fiqubb 12 


The octants 

In Figure 1^ yre have represented diagrammatically the right spherical 
triangle shown in the photograph of Figure 11. This diagram will be used 
frequently to represent the positive octant for three-dimensional factor 
problems, and it can be used to advantage in discussing factorial principles 
extending to more than three dimensions. The three orthogonal axes I, II, 
III, are shown at the corners of the co-ordinate triangle in Figure 12. 

A test vector that is collinear with one of the co-ordinate axes would have 
zero loadings on all but one of the factors. A test vector that is a linear com- 
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bination of two reference vectors lies in the plane that is spanned by the two 
reference vectors. The test vector can then he definerl by a vector equation, 
such as 

(19) WjiXi + WjiXs — J, 

in which Wji and are the weights as-signtsl to the tost vocUir J for the 
two reference vectors Xi and A'j. If the two weights art! erpial, then the 
test vector J lies midway between the two n!f(?ren(:e vncttirs in tlio plane 
I-II of Figure IS. If the weight is the larger, then the test vector J lies 
close to the first reference vector. If we write the equation t>f a tc-st vector J 
for the three dimensions of Figure IS, wc have 

(20) WjiXi -j- WjtXt -p WjaXa — J , 

in which the weight Wja is zero when the tc.st vtuitor J lie.s in tlio plane I-II, 

The signs of the three weights dctenninc the region in which the test 
vector J is located. If all three of the weights are iMi.sitive, the te.st vector J i.s 
located inside the positive octant, as mdh'atcd by t he Rign.s + + 4- in the 
positive octant of Figure IS. If the third weight is zero an«l the other two 
are positive, we have the weights 4- + 0, and the te.st ^'^!ctor then lies in the 
arc I-II of Figure IS. If the weights arc 0 + 0, the vector J i.s ctdliiiear with 
the second reference vector, as shown in the figure. Similarly, if tlu! weights 
are +0 0, the vector J is collinear with the first reference vc<!tor. If the 
first weight is negative, we have tlicw eights —h 0, and the vector J then 
lies in the plane spanned by the first and .second reference vo(!toi's, lus .shown 
in the figure. Similar relations hold for the weight combination + ~ 0 a.s 
shown. 

There are twenty-six sign combinations of the woigbt.s in c(iuation (2) 
which define the region in which the test vector can be located in three di¬ 
mensions, the combination 0 0 0 being eliminated becau.se it represents a 
null vector. If one of the signs is zero, the te.st vector lies iu one of the co¬ 
ordinate planes. If two of the signs are zei’O, the te.st vector i.s at the inter¬ 
section of two of the co-ordinate planes. The same reasoning (!nn be extend¬ 
ed to n dimensions. The fact that the weights of the (icpiution are all posi¬ 
tive does not imply that the configuration can be inclosed within a right 
spherical triangle unless the reference vecbjrs arc separated by rigid Hngle.s 
or acute angles. If the saturations of the tests in the several factors are all 
positive and if the factors are not negatively correlated, then the configura¬ 
tion can be inclosed in a right spherical triangle which becomes the positive 
octant. This is a special case of considerable psychological interest because 
of the fact that mental abilities do not seem to show any negative correla¬ 
tions and psychological tests are positively correlated, even when they rep¬ 
resent the most diverse tasks. 



CHAPTER VIII 

THE CENTROID METHOD OF FACTORING 

In factoring a correlation matrix the purpose is usually to account for 
the correlations with fewer factors than there are tests, so that r < n, where r 
is the number of factors and n is the number of tests. With fallible data 
there will always be residual correlation coefficients after the extraction of r 
factors unless r=n, in which case the residuals can be made to vanish ex¬ 
actly. The reason is that the rank of a correlation matrix for fallible data is 
always equal to its order. The factoring should be done so as to make the 
residuals as small as possible after each factor has been determined. The 
least-squares solution for this problem minimizes the residuals and maxi¬ 
mizes the factor loadings on each successive factor. The resulting factorial 
axes are the principal axes. These would be determined routinely in factor 
analysis, except for the computational labor that is involved for large test 
batteries of twenty or thirty or more tests. The centroid method, like the 
grouping*method, is a computational compromise. The main centroid axis 
for any given table of correlation coefficients, or residual coefficients, can be 
regarded as a first approximation to the major principal axis. The main cen¬ 
troid axis for any given correlation matrix, or residual matrix, is obtained by 
simple summational procedures after appropriate reflections of the test vec¬ 
tors with corresponding sign changes, and the results are often fairly close 
to the statistically ideal least-squares axes. In large problems it is sometimes 
desirable to determine an additional factor by the centroid method beyond 
what is required by the principal axes to obtain the same average magnitude 
of residuals. The subsequent rotation of axes from either method of factor¬ 
ing usually shows one or more residual factors that do not contain enough 
variance for dependable interpretation. 

Several theorems will be derived which involve the centroid of the test 
vector termini. These will be followed by numerical and geometrical exam¬ 
ples. The theoretical examples in this chapter are exact, in that all correla¬ 
tional elements are assumed to be known and the rank r is less than n, so 
that the rth-factor residuals vanish identically. An example will also be 
given showing computational methods that are suitable for experimental 
data. 

Centroid theorems 

Consider, first, the fundamental equation of multiple-factor analysis, 
namely, 

(1) Tjh = flj'iOjn -|- ayaOiia -!-•’•+ , 
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in which the correlntion between two tests, j iuicl h, is exprcsscitl in terms of 
the factor loacliiiRS of tliesc tests in r fjctlingonai factors. SuminiiiK each 
column of the correlation mati'ix, we hav(! 

(2) V rjk = H-+ ' 

V i > ' 

Summing for all columns, avc have 


(3) ^ ^rjt = + ■ . . + ^«Ar]^«yr. 

k T' k j k i k j 


Ut,,, — I 

k i 


But 

(4) 

so that 

^ 1 

k j . .1 L J 


* 4 - • • • + 


. > 


Let the sum of all the correlation coefficients (or resitliml coellicitmt.s) be de¬ 
noted Ti, then 


( 6 ) 


^_,^jk — I 

k i 


so that 



Wo then have the interesting tluiorein that thn muii of till. Ihr. voiflhicfitit in a 
correlation matrix in equal to the mini of the Kqunren of the roluniu ttumit in nnif 
corresponding orthogonal factor viatrix. 

For the purpose of illustrating the the(*r(ins of this chapter, a small (icti- 
tious example was written, as shown in Table 1, for live variables and two 
factors. The intercorrelations are shown in Tabic 2. The sum of the corre¬ 
lations is -I-.29. Applying the theorem to the sums of the fa(;tor matrix, we 
have (—.2)“-|-(-|-.5)“= -1-.29, which is also the sum of the correlations. In 
Figure 1 we have the corresponding configuration of five test vectors, which 
are drawn without reference frame. 
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rahle 1 


Ficlitious Factor ^ * 

Matrix Coirelation Matrix 



I 

II 


+ 1 


+3 

- 1-4 


1 

-.9 

-.1 

+1 

.82 

.60 

- .33 

- .64 

- .68 

2 

-.6 

-.6 

+2 

.60 

.72 

- .06 

- .48 

- .60 

3 

.4 

-.3 

- i -3 

- .33 

- .06 

.25 

.25 

.12 

4 

.7 

.1 

- 1-4 

- .64 

- .48 

.26 

.50 

.46 

5 

.6 

.4 

-1-5 

- .68 

- .60 

.12 

.46 

.52 

Z 

-.2 

.5 

2 

- .13 

.18 

.23 

.00 

- .08 




12 | 

2.97 

2.46 

1.01 

2.33 

2.28 



The centroid of a set of points is the center of gravity of equal weights at 
the points. The centroid of the test vector termini has the co-ordinates 



If the axes are so placed that the centroid lies in the first axis of reference, 
then the centroid has zero projections on all the remaining (r—1) co-ordi¬ 
nate axes. Hence, 

(8) ( 1)2 = ^ . 0/3 = • ■ • = 0;r = 0 , 

i i i 


so that the r co-ordinates of the centroid are 
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Substituting (8) in (7), we have 

(9) n = 

where the first axis contains the centroid. We then have the theorem that 
the sum of the coeMcients in the correlation matrix is equal lo the square, of the 
sum of the first centroid fador loadings. 

The first co-ordinate of the centroid of the te.st vector termini is atso its 
distance from the origin, since the remaining (r-1) co-ordinatas vani.sli. 
Hence the distance of the centroid from the origin is 

(10) d . Is-/. • 

J 

By (9) we have 

( 11 ) = 

in which the distance of the centroid ftom the origin is expressed in terms of the 
coeffidents in the correlation matrix. 

In order to determine the loadings oyi on the centroid factor, substitute 
(8) in (2). Then we have 

( 12 ) = 0*1 0/1 ; 

j 


and from (0) we get 

(13) ^ rjk = 0*1 V7t. 

i 


For convenience, let the column sums of the correlation matrix be denoted 
(14) ^Tjk^rk. 


Then 

(.p) 

so that 
(16) 


Tk = 0*1 v7,, 
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For computing, deteimine a multiplier m = Then 

vr, 

(17) aki = nirk, 

by which the first-factor loadings are proportional to the corresponding 
column sums of the correlation matrix. By (17) the first-factor loadings are 
numerically determined. 

By equation (9) we have a useful check on the conaputations, namely, 
(9o) = Vr<. 


Reflection of test vectors 

The correlation matrix of Table £ represents a configuration which is 
shown in Figure 1. The fact that no reference frame has been drawn in this 
figure corresponds to the fact that no reference frame is implied in the cor¬ 
relation matrix. A first axis in the configuration of five vectors evidently 
should be in the general direction of the vectors 1,2, 4, 6, since an axis in 
this direction through the configuration would make the projections the 
largest possible. It is of secondary consequence whether the positive sense 
of this first reference axis is in the direction of the test vectors 1,2, or in the 
direction of 4i S. 

Since the configuration is not immediately given by the correlation ma¬ 
trix and since it cannot be physically constructed or seen when the corre¬ 
lations involve more than three dimensions, it is a practical problem to de¬ 
termine the general direction of the longest dimension of the configuration 
by inspection of the correlation coefficients. When that can be determined 
by inspection of the correlation matrix, several of the test vectors can be re¬ 
flected so as to move the centroid as far away from the origin as possible. 
Then the first centroid axis can be located so as to account for a large part 
of the correlation coefficients, leaving their residuals as small as possible. 

Several criteria can be used to ascertain which test vectors lie in or near 
the longest dimension of the configuration. These criteria are not always 
consistent, since a configuration has extension in several directions. One 
criterion is to determine the absolute sum of the correlation coefficients, or 
residual coefficients, in each column. That test vector which has the highest 
absolute sum is likely to be in or near the longest dimension of the test con¬ 
figuration. Another criterion is to find that column which has the largest 
absolute sum, ignoring the diagonals. One simple method is to select for re¬ 
flection that test vector which has the largest number of negative coeffi¬ 
cients. This process can be continued until each column has a majority of 
positive coefficients. Another method is to sdect for reflection that test 
vector which has the highest communality. Inspection of the correlation 
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matrix of Table 2 indicates that test veftnrs 1 aiul 2 slmiild l)e rcllei-led. 
When these columns and wnvs have been irvcnc«;il in si|iii, I he iTsnlfiiij!; cor¬ 
relation matrix is shown in Table 3, and the. coufiKUratinn, afI cr rtdlccfwin, is 
shown in Figure 2. The centroid of the. rellecteri ctmtiKUrati'in is shnwn at 
point c in Figure 2. 



The computation of the first-fa<rtt)r loatlings is shown in Taltlr 3. Sum the 
columns to find r* for each column. Find the total .sum ri and the multiplier 
m. Apply the multiplier to find the fimt-faiitor loudinK.s tt,i jus shown. 
These loadings correspond to the vaiiable.s with .sign.s, a-s .shown in Table 3. 
The same factor loadings are recorded in the faidor matri.x of Tabln for all 
variables with positive sign. 




Table 3 




Table 



Correlaliena after Sign Changee 


Factor .'ifutrix 



-1 

-2 

+3 

+4 

+.1 


1 

tl 

-1 

.32 

.60 

.33 

.64 

.58 

1 

-.893 - 

.149 

“2 

.60 

.72 

.06 

.48 

.60 

2 

3 

-.740 

.414 

+3 

.33 

.06 

.25 

.25 

.12 

.304 

.397 

+4 

.64 

.48 

.25 

.50 

.40 

4 

.701 

.094 

+5 

.68 

.60 

.12 

.40 

.62 

6 

.080 - 

.223 

fl/l 

2.97 

.893 

2.46 

.740 

1.01 

.304 

2.33 

.701 

2.28 r,= 11.05 
.686 £aj,B3.324 

£ 

.058 

.533 


I 


300828 
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The theorem of ecumtioii (!)) cjui bo verified in Table 3. The s\im of the 
hrst-factor loadings, with variables 1 and 2 reversed, is 3.324, and (3.324)= = 
11.05, which is the sum of the coefficients in this table. The first-factor 
loadings in Table 4 represent all variables with positive sign as originally 
given. 

The first-factor residual coefficients can be written by equation (1), in the 
form 


(18) 


Vi.jk = rjit — ajiCki = ■ 

nis2 


The first-factor residuals are shown in Table 5. They were computed from 
tlic given coefficients in Table 8 and the first-factor loadings, first column. 


Table S 


FirsL-FadoT ResiduaU 

1 

+ 1 

+ 2 

+3 

+ 4 

+ B 

+ l 

,023 

-.001 

-.059 

-.015 

.032 

+2 

-.001 

.172 

.104 

.038 


+3 

-.OfiO 

.104 

.158 

,087 


+4 

-. 01,>5 

.038 

.037 

.009 


+5 

.032 

-.093 

-.089 

-.021 


Ch 

-.079 

.222 

.212 


-.120 

S 

-.080 

.220 

.211 


-.122 

isl 

.190 

.628 



.284 

Sr . 

-.103 

.048 

.083 

.039 

-.171 

Nor . 

3 

2 

2 

2 

3 


of Table 4- The check auras, Ch, of Table 5 were obtained from the column 
sums S of Table 3 and the first column of Table 4- Example: — .13 — (— .893) 
(-t-.058)= —.079. The algebraic column sums are shown in row S and the 
ab-solute column sums in row ] 2l of Table 5. The sums, omitting diagonals, 
arc shown in row Sr„ and the last row shows the number of negative co- 
efficiemts in csach (u)luinn. Ordinarily, all these rows are not computed. 
They are shown here to illustrate different methods of deteimining which 
variables to reflect. By the absolute sums we could reflect test 2. By the 
sums, omitting the diagonal, we could start by reflecting test 5; and, by 
counting the number of negative signs, we could reflect either test 1 or 
test 5. 

In Figure 3 we have the original configuration of five points and the first 
and second centroid axes. The correlation matrix in Table B is of rank 1, 
and its configuration is therefore of dimensionality 1. The one-dimensional 
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residual configuration is shown in Figure Si wlierts iho fi^o tcsit VL’chtrs are 
indicated by as many collinear arrows in the .secoiul ceiilroid axis. Tliese 



Figure 3 


residual vectors are seen to be the projections t»f the, live nrigiiiul l(!st vectors 
on a one-dimensional subspace (axis II) orthogiinal to th(i lirst axis. When 
the residual vectors 1 and 6 are reflected, the resiiltiiig five vectors are uni¬ 
directional, and the second-factor loadings are then equal to tlic‘ residual 
vector lengths. The computation of the .second-factor loadings i,s shown in 
Table 6, and they are recorded with proper sign in the st;ct,md (*ulumn of Ta¬ 
ble 4- The second-factor residuals vanish, since the given corridation matrix 


Table G 


First-Factor liesidnals (tfter Sign Cliangrn 



-1 

+2 

+3 

+ 4 

~n 

-1 

.023 

.001 

.059 

.015 

.032 

- 1-2 

.001 

.172 

.164 

.038 

.003 

- 1-3 

.059 

.104 

.158 

.037 

. 081 ) 

- 1-4 

.016 

.038 

,037 

.000 

.021 

-5 

.032 

.093 

.089 

.021 

.049 

r * 

.190 

.628 

.507 

.120 

.284 

a,fl 

.149 

.414 

.397 

.004 

.223 


.7835 
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of Table 2 is of rank 2 and the rank of each residual matrix is one less than 
the previous correlation matrix. 

The group centroid method 

The procedure to be described here is one of the simplest forms of the 
centroid method. 

In Table 7 we have an eight-variable correlation matrix. The last column 
shows the algebraic sum of each row, and it will be used for check purposes. 
The check column is vacant in the given correlation matrix. The first sum¬ 
mation row shows the absolute sum of each column. The highest absolute 
sum is 4.06, so that test 8 is chosen as a pivot test. In this column we choose 
several tests, in this cose three, which have the highest correlations with 


Table 7 

First Factor Determined hy Group Centroid M^hod 



1 

2 

3 

4 

8 

0 

7 

8 

Ch 

3 

1 

.SO 

.27 

.10 

- .63 

.15 

.03 

.OD 

- .24 


.430 

2 

.27 

.1)4 

- .38 

- .10 

.48 

- .17 

- .61 

.03 


.660 

3 

.10 

- .38 

.87 

- .41 

- .64 

.62 

.06 

- .57 


- .660 

4 

- .83 

- .10 

- .41 

.06 

.10 

- .26 

- .08 

.47 


- .130 

s 

.16 

.48 

- .54 

.10 

.86 

- .77 

.29 

.37 


1.240 

0 

.03 

- .17 

.32 

- .23 

- .77 

.81 

- .47 

- .76 


-1.100 

7 

.00 

- .61 

.00 

- .08 

.26 

- .47 

.80 

.43 


.700 

8 

- .24 

.03 

- ,67 

.47 

.87 

- .70 

.43 

.86 


.860 

2|r/*| 

2.00 

2.88 

3.24 

2.30 

3.80 

8.82 

2.82 

4.00 



a 

0 

0 

■KM 

0 

+ 1 

-1 

0 




2r,* 

- .12 



.83 

2.30 

-2.37 

1.10 

2.32 

3.20 

3.20 

u 


0 

-1 

+1 

+1 

-1 

+1 

+ 1 



Srii* 

- .78 

.46 


1.81 

3.23 

-3.02 

1.64 

3.79 

4.30 

4*.ao 

0)1 

- .182 


- .020 

.440 

.786 

- .880 

.471 

.921 

1.046 

1.044 


T - 10.04 V? - 4.US823 m - .242900 
2a„i - 4.117 (4.117)> - lO.OS 


test 8, disregarding sign. These correlations are r6B=-|-.67, r68= —.79, and 
^88=+-86. In practice these subgroups may contain three to five tests or 
more, provided that only those teats are included in the subgroup which 
have significant correlations with the pivot test. 

The three tests in the subgroup are 5, 6, and 8, and the signs of their cor¬ 
relations with test 8 are -h, —, and -j-, respectively. In row s we record unit 
weight with these signs for columns 5, 6, and 8, and zeros for the rest, as 
shown. 

In the next row we record the column sums for these three rows with signs. 
The first entry in row Sr,* is obtained from the first column, namely, 
(-I-.15) —(-f .03)-|-(~.24) = —.12. The other entries are obtained in a sim¬ 
ilar manner. The check sum is obtained from the S column, namely, 
-f-(-t-1.240) —(—1.100)-l-(-f-.860) = -|-3.200, which is the expected sum. 
The actual sum of the row is the same, and it is recorded in the S column. 

Note, next, the highest absolute sum in this row, which is —2.37. As a 
practical, but somewhat arbitrary, rule, we note that one-third of this sum. 











1 

2 

3 

4 

5 
0 

7 

8 


1 


.407 

.200 

.077 

.400 


.130 

.170 

.072 


Slri*! 

a 

£T.k 

u 

Srulb 

oyi 


1.000 
0 

. 3:10 

+l 

.707 

.300 


7 uWc s 

Second Factor Dcicrndnal by Croup (‘mlwid Mrlhoil 


2 .3 I 


.200 

.028 

.312 

.148 

.304 

.074 

.001 

.070 

.077 

- .312 
.180 

- ,137 

- .003 

- ,020 
.3.'i2 
.001 

- ..l.'iO 

- ,148 

- ,137 

. 4,00 

- .21.'. 
.127 

- .287 

.00.'i 

1 

II 1 M i 

- 

- .071 

- Oili 
.127 

- .070 

- .orrfi 
.U2II 

2.777 

1.144 

KOU 

1.4II 

.rii.s 

H-l 

-1 

0 

1 1 

II 

2. lOfi 

- .003 

.031 

.771 

- .1)71 

+ 1 

-1 

(1 

+ 1 

II 

2.485 

- .820 

- .410 

1 .INi'l 

- .201 


- .320 

- .102 

.412 

- .07H 


T = 0.007 Vr = 2..'iS011« I. 

- u.m =• i!.i 


7 

s 

f'fi 

V 

.170 

- 072 

.n.-i.i 



-- 07j) 

.110 

.117 


.001 

osr 


~ .287 

.0115 

- .0)0 

.010 

— .OSlI 

- ii.',) 

.121) 

.421 

— .I|.“li 

112:1 

- ,181 

' 182 

,1111s 

- .01)1 

.2. IS 

.2i)S 

- ,0111 

III 2 

' 102 

.nil 

2.181 

.■207 



-1 

II 



-1 .lilW 

.1211 

.•'iV2 

..'72 

-1 

II 



-1 ,IS,-| 

- 102 

1 222 

1.223 

— ,570 

- .1171 

.173 

.171 




Tabic n 

Third Factor Delerminnl by Croup Centroid MtlluHl 



1 

2 


3 

4 

3 

0 

7 

8 

rh 


1 

.372 

- .008 


.170 

- .Kill 

.Hill 

- .100 

.3,11 

- 010 

.Jiiri 

.30.1 

2 

- .008 

.001 


.001 

.008 

- .1813 

.0111 

- .IIIHI 

.1811 

-- ,iHni 

- .mil 

i) 

.170 

-.004 


.081 

- ,1811 

,070 

- . 0.11 

, 111 s 

- .0.!,l 

.2II1 

210 

4 

- .400 

.008 


.1811 

,430 

- .178 

.III 


.0.13 

... .112 

- .312 

5 

.100 

- ,003 


.0711 
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T = fl.n.'iS Vr = 2..'i8ll3I0 m " ..337.WII 
Sn„, = 2.080 (2..-|80)= = fi.O.lti 

Table 10 

Factor Matrix by Group Centroid Method 
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whicli is .HO, iiiul iill i‘ii1uiiliis wIiosg Klims arc loss than this number 
arc givc'n a weiftht (if z(!in in tlm next row, u, as sliown, The other rolumns 
are given weiglits of +1 or -1 aoporcling to the signs of Sr,* as shown. 

With the weighls u we fiml the eolninu sums Sr„fc, which are recorded in 
the next row. 'fho first entry in this i-ow is obtained from the first column 
with the weight.s given in the row n. It is —(+.l 9 )-t-(_. 63 )+(-|-.i 5 )_ 
(+.0;'5) + {+.tl'-U + (“-‘'i'l) —■7ri. The cheek sum, +4.30, is obtained with 

similar weiglits from the « eolinnii, anil it agrees with the actual sum of the 
entries in tlii.s row. 

Siunniing the entrie.s in the row and applying again the same weights, we 
have 

+ 2.55 + 1.81 + 3.23 + 3.(52 + 1..Q4 + 3.79 = 16.94 = T, 


from wliich we obtain the multiplier 242965. Applying this 

multiplier to row -r,,* and to its sum 4.30, we have the factor loadings a,i 
with iiroper sign.s and their expected sum, 1.045. The actual sum of the row 
is 1.014, and it i.s recorded in the column. Finally, the algebraic sum of 
the row with wiMghls it is S,'a„i=4.117, and the .square of this sum is equal 
to the value of 7' or ri of equatiou (Oit). 'I'lie factor loadings in row a/i are 
copied <lire<‘lly in t he first column of the factor matrix in Table 10. 

Table fi shows similar computations for the socond-factor loadings. The 
check column is ohtaiuud from the S column of Table 7, the first-factor 
loadings, and their sum, 1.045. The check .sum in the first row of Table 8 
is obtained thus: +.4G0“-(-.lS2)(1.045) = +.650. The actual sum of the 
residuals in tlie fir.st row of J'a/ife 8 i.s +.651, a.s recorded. The second-factor 


loadings, n,a, are recorded in the second column of Table 10. 

Table !) slinws the corresponding computations for the third-factor load¬ 
ings. The thiul-faclor lusiduals computed from Tables 7 and 10 vanish in 


the riingc ± .001, 

The computational routine for wluit we have called the “group centroid 
method’’ is so simple Ihul a clerk can easily learn it. Attention should be 
called to the fact that the subgnmp s should include three or more tests. 
If only one i)ivoL Ic.st wiu'c used and if the weights u were made +1 or —1, 
omitting tlie zero weight, then this method would reduce to what was 
ealled the “.siinplilied centroid inetliod," which was published in 1933.* 
That method wa-s defective, in that the cominunalities of the pivot tests were 
too higli, Konudimes evim e.vccediug unity. Moreover, the method did not 
piTiperly separate the common factors from the unique factors. The method 
which has been described hero and which has been called the group cen¬ 
troid method” avoid.s these difficulties by using the subgroups s and by using 
the throe weights for u. However, the group centroid method is probably 
* .1 Simplified Multiple Factor Method (IlniverBity of Chicago Bookstore, 1933). 
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THE CENTROID METHOD OP FACTORING 

not so effective as the complete centroid method in separating the common- 
factor space from the unique test space. 

The complete centroid method 

The complete centroid method which has been in use in the Psychometric 
Laboratory for a number of years will be described here. This description 
will be given in terms of the computations on a standardized data sheet, 
which is illustrated in Tables 11-lS inclusive. The complete centroid 
method will be described with a numerical example of twelve variables, and 
we shall include here a description of all the numerical cheeks which consti¬ 
tute a part of our computational routine. The computational cheeks are 
explicitly shown on the data sheets. 

By the complete centroid method we mean the successive reflection of 
variables, one at a time, until all the column sums in the correlation matrix, 
or the residual matrix, are positive or zero. These column sums include the 
diagonal entries. No matter what the signs may be in a given correlation 
matrix, one can always reflect some of the variables so that all the column 
sums become positive or zero. In the complete centroid method this work 
is done systematically by reflecting one variable at a time. While it is al¬ 
ways possible to make all the column sums positive or zero by reflecting 
some of the variables, the factorial solution is, in general, not unique. If 
simple structure exists in the test configuration, the rotated factor matrix 
is unique. It is independent of the factor matrix that is obtained by the 
centroid method. The lack of uniqueness of the centroid method of factor¬ 
ing constitutes, then, no problem because the rotated factor matrix is unique 
and the structure is unambiguous. 

The following paragraphs are numbered to show the successive computa¬ 
tional steps in the complete centroid method with successive adjustment 
of the communalities: 

1. A given correlation matrix with twelve variables is recorded in Ta¬ 
ble 11. The diagonal entries are left blank, as shown. This example 
is intended to show the computational routine that is used on experi¬ 
mental data for the particular case in which it is decided to adjust 
the diagonals after each factor has been extracted. 

2. The column sums are recorded in row s, and the row sums are re¬ 
corded in the column S. The sum of all the entries in the correlation 
matrix is 79.40, which is recorded at the intersection of row s and 
column S. 

3. Since all the given correlation coefBcients are positive in this exam¬ 
ple, we omit several steps that are required for subsequent factors. 
Row s is copied into row C, as shown. 

4. The communalities are recorded in row i. Here the computer decides 
how to treat the unknown communalities. He may use one of the 
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estimation formulae for the communalities and record the estimates 
in this row. Several such formulae are described in chapter xiii. If 
lie iliKiides to use unit communalities, these may be recorded in 
row d. I’lie .siniplast estimation foimula is to take the highest co- 
elficicnt in each column as the estimated communality, and this is 
the method u.sed in the present numerical example. The data sheet 
is designed .so that it is applicable for any method of estimating or 
computing the diagonal values. Since there have been no sign 
clianges in this tabic, row d is copied into row D, as shown in Table 
11 . 

5. Row Ji gives the sum of C’+D. 

6 . The entry 88.32 in row E is the sum of the entries C and D immedi¬ 
ately above it. Row E Is then summed. If the sum agrees with the 
already recorded sum, this fact is indicated by a check mark, as 
shown. 

7. The first entry in the small table at the lower right corner is 88.32, 
which is obtained from row E. It is denoted T. 

8 . The value Vt is next recorded, as shown. 

11 . The reciprocal w is recorded in the next space. 

10. The prodiKit mT is equivalent to 9.40 and is recorded in the next 
space. 

11. Next, it is verified that this value checks with vT. This verification 
i.s indi<;atcd by the check mark, as shown. 

12. The last row of the table shows the factor loadings, which are the 
products viE, as shown. Applying the same multiplier to the check 
.sum gives niSE-dAQ, as shown. 

13. The algebraic sum of the last row is 9.39, as recorded in the S col¬ 
umn. The fact that these two sums agree, namely, 9.39 and 9.40, is 
indicated by a check mark. 

14. The sum of the absolute values of the entries in the last row (9.39) is 
recorded in the small table. The fact that it agrees with the value 
of mT is shown by a check mark. 

l-l. The first-factor loadings are recorded in the first column of the factor 
matrix F in Table 15. 

The calculation of rcddualH 

The computation,s for the first-factor residuals and for the second-factor 
loadings arc ciarricd out on u now data sheet, as shown in Table IB. The suc¬ 
cessive steps in these computations are as follows: 

1. The first-factor loadings arc recorded in column H-a, as shown. The 
sum of this column (9.39) is also recorded. 

2. In the top row (b=—d) the same factor loadings are recorded with 
reversed sign. The sum of the top row is v— 9.39, as recorded. 
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3 . The first-factor residuals (p/*) are ordinarily cxiiiesmid in tin? form 


Pik = TSk ~ ctjian . 

Since the first-factor loadings, a/i and a*i, may bi( i«isil ive or npgu- 
tive and since their product is prereded by a minus sign, tlio com¬ 
puter is ordinarily required to keep in mind tlicst; three signs. The 
computational routine is simplified by expressing tlie residual in the 
form 

pjk = r,ii -b (OjiK—On) . 

The factor loading (aji) is represented in the column (+«) and the 
factor loading (—Oti) is represented by the b)p row (/«) on tlu! data 
sheet. The actual computation of residuals will be ilhwtr.'itcd for the 
first correlation coefficient, namely, rsi= -f .17 in Tnhlr II. The resid¬ 
ual psi is to bo recorded in the cell entry (21) in 7’aWc L'J. 'rh(‘ factor 
loadings .70 and —.59 are found in column n and row h directly op¬ 
posite the cell entry (21). The actual computation for this re.>iifiual 
then is 

.17 -1-(.70) (-.50) = “.2.1. 

The residuals in the rest of the column for the first variable are com¬ 
puted in the same manner. The diagonal cells am left blank in the 
residual table. 

4. The check sum (—.25) for this column of re.si(luiil.s i.s next recorded. 
The value s is obtained from the previovm data sheet. In detail the 
computation for this entry is 

4.94 + (9.39) (-.59) -f (-.59)* = -.25 . 

5. The sum (—.23) of the first column of residuals is recorded in row s. 

6 . If this sum s agrees closely with the check sum Ch, as in the*. pre.sc>nt 
case, it is assumed that the computations were done correelly. The 
slight discrepancy is to be expected from rounding. When llie agree,- 
ment of the sum and the check sum has been noted, tins first ctdumn 
of residuals is copied into the first row of the table. The .sum (« = 
—.23) is copied into column S. 

7. The transcription in the first row is verified by actually summing that 
row. The agreement of the actual sum with the recorded sum is in¬ 
dicated by the check mark. 

8 . The residuals for the second variable are next computed, beginning 
in cell (32). When the residuals in the second column have been com¬ 
puted, they are verified in the rows Ch and s as before. The second 
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column of residuals is then copied into the second row and verified by 
adding the second row. The rest of the residuals are computed in the 
same manner. It should be noted that the number of residuals to be 
computed is reduced in the successive columns. When the computer 
reaches column 11, he has only one residual to compute. When the 
computer reaches column 12, there are no new residuals to compute. 
The last column is verified by the check sums. 

9. The final check for the whole table of residuals is obtained in the 
form 

Ss - . 

Its numerical value (—1.32) is recorded as shown. 

10. The sum (—1.30) of the row Ch is next recorded. The fact that this 
sum (— 1.30) agrees closely with the previously recorded sum (—1.32) 
is represented by a check mark in the small square. * This verifies the 
computations in the row Ch. 

11. The sum ( — 1.28) of the row s is next recorded. The fact that this 
sum agrees closely with the two sums just recorded is represented by 
a check mark, as shown in the second small square. 

12. The entries in column S are summed. The fact that this sum agrees 
with the already recorded sum (—1.28) is represented by a check 
mark adjacent to this sum. 

The sign changes 

1. If all the entries in row s are positive, then no reflections are necessary. 
This was the case in Table 11. However, in Table 18 row s contains 
negative entries. Hence we proceed by recording the entries in row A. 
Tlie entries in row A are recorded to three decimals. The previous cal¬ 
culations have been recorded to two decimals. The anticipated sum 
(.640) is recorded, as shown. Bow A is next summed. The fact that 
the sura agrees with the expected sum is represented by a check mark. 

2. The highest positive number in row A is .120. This number is written 
in parentheses, and it occurs in the second column. This fact is rep¬ 
resented by writing + (2) at the beginning of the next row. 

3. Each entry in this row is the sum of the corresponding cell entry of 
row A and the second row of residuals. For example, the first entry is 


(.116) -t- (-.24) = -.126. 

In the sign-change calculations the diagonal entries are treated as 
zeros. Thus the second entry in row -l-(2) is the same as the second 

* The boxes in the printed data sheet are represented here as parentheses. 
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entry in row A. Each entry in this row is writli-n in puifiillicscs if (ht- 
corresponding eiitiy in inw A is in piirontlicsi-s. 

4. The anticipated sum (.400) is nbtainnl froin tlic rnrrt siii.mling en¬ 
tries in column 2, namely, .(>40 and —.21. The .sum of the new njw 
agrees with the anticipated .sum, .400. Thi.s fact i.s p*pie,«f“ii(c*d hy (lie 
check mark. 

5. The highest po.sitive sum in this row is .‘275, and hcneo 11ds nuiulier is 
written in parentheses. Tills number is in eoliimn 0, and tlierefore the 
next row is denoted 4-(9) tis .shown. Eaeli entry in row biOj i.s the 
sum of the corresponding entries in row +^2) and in tin* ninth row of 
residuals. For example, the finst entry i-s 

(-.125) + (-.19) = -.:iir>. 

The sums in row +(fl) arc written in parentlie.ses if the (•oi're.'iiiuniliiig 
entries in the previous row.s an* in parenthese.s. It will be seen lliat 
the entries in these columns are written in parentheses aller the sign 
change for that column. Thu entries in row 4 (91 are summed and 
checked os before. This procedure eonliniies until all tlie enirie.s in a 
row are negative, zero, or positivi,* in piireiilhe.«e.s. 

It happens occasionally, (wpeeiully with a large te.sl battery, that a 
test vector is reflected twice. In determining the. iiesi variable which 
is to be reversed, wc (diooHC eitlier the largest positive number without 
parentheses or the largest negative iiumbt'r in parent he.se,s, wbieliever 
has the larger absolute value. The .same i'e,sull. i.s olitaineil if we regard 
the parenthases as the cqnivulent. of a lu'gative .rign and if I lie rule i.s 
adopted of reversing that variable which ha-s the large.*;t ]iosilive value. 
If, according to the rule, a variable inu.st be n*versed whieli lots previ¬ 
ously been reversed, this can be aeeomplislu*d by .sulitraeting tin* cor¬ 
responding row of residuals instead of ailding, a.s in tint regular pro¬ 
cedure. 

6 . When all the entries in a row urc zero or negative, eminling i)an‘ulhe.s(’.s 
as the equivalent of a negative .sign, lliLs row is denoted li, as shown in 
Table 12. 

7. The entries in row C arc reisirded to two ileeimiils. 

8 . The weighted sum of the twelve entries in eoliuiin 2 is re<‘<trded in 
row C. Each weight is either -|-1 or -1. 'J'lie weight is 4-1 if t lie vari¬ 
able has not been reversed, and it is —1 if the variable ba.s lieen re¬ 
versed. The weighted sum of the twelve entries in eolmuu 2 is tlien 
— .12, as shown. 

9. The entries in row C are summed. The sum must equal the antici¬ 
pated sum, which here is —.12. This agreement is represented by the 
check mark. 
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The communalities 

1 . In row d are recorded the estimated diagonals. Each entry in row d 
is the largest absolute value of the residuals. For example, in the 
second column the residual with largest absolute value is — .24. It is 
recorded in row d with positive sign. 

2. In row D the same values are recorded with the signs indicated in 
row C, The weight, ;i, is +1 for unrefiected test vectors and — 1 for 
reflected vectors. The sum (.18) of row D is recorded as shown. 

Calculation of factor loadings 

1 . Row E is the sum of entries in rows C and D. The anticipated sum 
(.06) is, similarly, the sum of S-entries of rows C and D. Row E is 
summed. The fact that the sum of row E is equal to the anticipated 
sum (.06) is indicated by the check mark. 

2. The sum of the absolute values in row E is 10.60, which is recorded in 
the small table. Jt will be noted that S j F j = SjiiF. 

•3. The value of Vt is next recorded in the small table. 

4. The reciprocal m is recorded in the next space in the small table. 

5. The product otT is recorded in the next space of the small table. It is 
recorded to two decimals. Its agreement with VT is indicated by the 
check mark. 

0. The factor loadings are recorded in the lost row of Table 12. The an¬ 
ticipated sum, nCLE =.02, is recorded in the check column. 

7. The sum of the factor loadings (.03) is recorded in the S column. The 
fact that these two sums agree closely, namely, .03 and .02, is indi¬ 
cated by a check mark in the small square. 

8 . The sum of the absolute values (3.27) of the factor loadings is recorded 
in the last space of the small table. The fact that this sum agrees 
closely with mT is indicated by a check mark in the small square. 

The same routine is followed in computing the second-factor residuals, 
which are shown in Table 13. The third-factor residuals are shown in Table 
14. These residuals are too small to justify further factoring. 

The factor loadings are assembled in the factor matrix F of Table 15. The 
fourth column of this matrix shows the conomunalities as determined by the 
centroid method, with successive adjustment in the diagonal cells. The last 
(iolumn of this table shows the true communalities, which are consistent with 
the side correlations of the given correlation matrix, which is of rank 3. 

When the true communalities are known, as in the present fictitious ex¬ 
ample, the same data sheets can be used for the centroid method in such a 
way that the third-factor residuals vanish identically. The obtained com- 
inunalities are then exactly equal to the true communalities. The procedure 
is then to record the true communalities in row d of TMe 11. In computing 
the residuals for Table 12 the communalities are treated in the same way as 
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the coiTelation cocffifionts. TJw; rcsuhial (‘nttitiiitrialitics arr fhi'ii ii-conh'd 
in row d of Table 12 without any adjiisltncnl. Wlnni tliis proffilure is fnl- 
lowed, the third-factor residuals vaiiisli idcntifullv, iiii-JiidiiiK tin. l•(»Iatnu- 
nality residuals, and the obtained roniiiiunalities (ire crjiial tu the true com- 
munalities. This procedure would b(? uwnl with {?xiHTinir*nfal data except 
for the fact that the true cimimunulitics arr* nnkioiwri and iiujsl bo 
estimated. In dealing with oxiM-riineutal data flic rc.sidual ctiniinunalitic.s 
are adjusted after each factor has bmi extracfcil in di,. munner wliich has 
been described. The computer may prefer .some other incHitul of adju,sting 
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the ^timate of the comniunalities f<,r each residual table l,y u.siug one of 
the estimation formulae in chavter xiii. 


A multiple group method of factoring the correlation matrix 

cuS the correlation niafri.x require (ho lud- 

thi •^'cH’aetcd. 'I’hi.s i.s pcThaps 

the most laborious part of factoring. Th« method to l,c de.seribed here 

bince the method turns on the selection of groups of test veelor.s it will he 
tmetl“ o/facloring* 'I’l,,. hod can be u.sed for ox- 

for the^mom ‘^ut it will bo eonsidored hero 

TheZn 7 fundamoni al ivlation FF' = It 

The multiple group method of factoring is general, in that it eL be u.scd 

Psychometrika, X (June^ 1945 ) 1 ^ 73 . 58 *”^ Method of FaetoriiiK tlio Correlation Matrix," 
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on a corrolation inii( rix of any rank, any order, and any configuration of test 
vectors, and the method is successful for any arbitrary grouping of the 
tests, provided tliat the several groups of tests are linearly independent.* 
This method of factoring has a limitation, in that the communalities are as¬ 
sumed to be known at the start. This is not a serious hardship, because the 
factoring can be repeated with the communalities that are found in the first 
trial and the convergence toward the correct comm u nalities can be expected 
to be rapid. 

This method of factoring is based on the well-known principle that a 
common-factor space of r dimensions is spanned by any set of r linearly in¬ 
dependent vectors in that space. The group centroid vectors are used for 
this purpose. 

The method of selecting the groui® of tests is not crucial for the multiple 
group method of factoring, since the only requirement is that the centroid 
vectors for the several groups shall be lineai-ly independent. This condition 
is nearly always satisfied without taking any special precautions about it. 
With experimental data it would be a rare case in which this condition 
would not be satisfied. If, by chance, the centroid vectors for the several 
groups should happen to be linearly dependent, then this fact would become 
apparent in a later step of the calculations in which an inverse is computed. 

In selecting the several groups of tests for the purpose of factoring, the 
computer will naturally put together the tests that have high intercorrela¬ 
tions. He will select, for each group, those tests which are nearly coUinear, 
if such groups can be found in the correlation matrix. If such groups are not 
readily seen by inspection, then the grouping can be carried out by some 
other routine. One such routine is as follows: Select, as the first pivot, a 
test which has one or more significant correlations and which also has an 
appreciable number of low coefficients, if these can be found. Arrange as a 
group those tests that have significant correlations with the first pivot test, 
either positive or negative. Retain, as the first group, those tests which, by 
reflection if necessary, produce a subgroup in which all correlations are posi¬ 
tive or zero. Choose the next pivot test from the remaining tests in the 
same manner. Proceed in this way until all the tests with significant corre¬ 
lations are represented in the several groups. The grouping of the tests can 

* Holzingcr hna desuribed a factoring method which anticipated the first two parts of 
the multiple group method of factoring, namely, the computation of an oblique factor 
matrix Y by summations and the computation of the correlations between the group cen¬ 
troid axes ("A Simple Method of Factor AnolysiB," Paychomelrika, Vol. IX [December, 
1944]). The multiple group method adds a third step, namely, the computation of an 
orthogonal factor matrix F, which is the starting-point for the rotational problem. In de¬ 
scribing his factoring method, Holsinger limits the method to correlation matrices which 
can be divided into sections of unit rank., However, his method is general, and it can be 
used on correlation matrices of any order, rank, and configuration. His method is alge¬ 
braically equivalent to the first two steps in the multiple group method. 
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be carried out in any one of aeveral ways for the multiple group method of 
factoring. 

In Table 16 we have a numerical example which illustrates the multiple 
group method. The given correlation matrix has eight variables with inter- 
correlations as shown. The communalitiea were known in this case. With 
experimental data the communalitiea must be estimated. In the present ex¬ 
ample, the grouping of the tests was quite arbitrary, with little reference 
to the correlations. Tests 1, 2, 6, and 7 were placed in group 1, and tests 
3 4, 6, and 8 were placed in group 2. Only two groups were used in this 
example. The natural procedure is to group the teats into correlated clus¬ 
ters as far as possible. The multiple group method is not dependent on the 
grouping, and hence the gioups were selected arbitrarily for this numerical 

example. , - t o 

In row iSi wo have the sums of columns for rows 1, 2, 6, and 7. In row /hs 

we have the corresponding sums for rows 3, 4, 6, and 8. The correlation 
matrix has now been augmented by two rows, but the rank is unchanged 
because these two rows ai-e linear combinations of the given eight rows. If 
two similar columns were added to the right of the correlation matrix, we 
should have an augmented correlation matrix of the same rank. This hM 
not been done in TabU 16 because it would simply be the transpose of the 
two rows of matrix S, which are already computed and recorded in the table. 

The sum of the corresponding entries in each row of the matrix S are 
then computed and recorded, as shown in matrix T. For example, the entry 
1.28 is the .sum of columns 1, 2, 6, and 7, of the first row of S. The ot er 
sums are computed in the same manner. The square matrix T is of order 
2 X2, and it represents the lower right corner of the augmented correlation 

matrix in which the ranlc is unaltered. . j- 

The next step is to compute the reciprocals of the square roots of the di¬ 
agonal elements of the matrix T. These are the weights and w„ which 

are shown to the right of the matrix T. . ..r,™ 

The matrix V is computed by applying the weight u;i to the first row 
of S, and the weight Wj to the second row of S. Similarly, the same J 
on the rows of T give the square matrix U, as shown. The matrices V an 
U may bo thought of as two rows by which the correlation 
b^e augmented iLead of the rows of S and T. The matrix U wouldj^hen Je 
the lower right corner of the augmented correlation matnx, in which 

^**^T^iie two W^£ts, Wi and w*, are applied to the col'imns of the ma¬ 
trix U, and we then have the matrix E,, with T^ mitix 

tions are in part checked by the umt diagonals of this matrix. This matnx 

shows the cosine of the angular separation of the two umt 

that have been chosen. Each one of them contains the centroid of a group 

of test vectors. 
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If we write the tninapose of the matrix I*', we liave an oblijpif; hu-tor m® 
trix V, as in previous methoils of rotatit»n from the ortiuigoiml fat-tor tna" 
trix F, but we have obtiiijicd iiore the oblhpie matrix tiinjcfly and without 
computing the orthogonal factor matrix F, whieh i« ii.sindly obtained first 
by the various factoring melhodH. ' ' 

Since we have here un oblitiuo factor nmfrix V, ms well as tlie cosines of 
the angular separations of the unit reference vcclttm for the factor nitifrix V 
we can determine the transforiunUtm which sht.uhl carry tin- obliqne fapttir 
matrix V into an orthogonal factor matrix Since the- location of an or 
thogonal frame in the system defined by 1' and V is not unique, we must 
firat define in some convenient way the location of the dt-.sired orthoaonal 
rdeience axes of F. We shall do this by locating the first of the orthoKonal 
references axes collinear with tlie first of the ribliqnc axes. Then the first 
column of F will be the same as tlie first column of V. The next orthogonal 
ref^ce aius will be located in tlio plane of the first tw.» ohli,,u„ axes and 
orthogonal to the first one. This process is, in fact, the fliagonal method of 
factoring applied to the correlation matrix if„,. When this is carried out 
routmely, we have the factor matrix /■',«, in which the iw,, oblique ref- 
erence axes p arc defined in the orthogonal friinm vi. 

The inverse of the transpose of this inatiix givc.s (F' ) ‘ \\'t> i-nn 

‘-ll-Konallu-torTnatri ;: 

TZT . "»■» 7>. Tl.» trawfor- 

FA-‘ = F , 

from which we have 


( 20 ) 


FA = V. 


where A is already numerically given 

... - * 

Table 16. ««!»<- '•orner of 

'“'I" 

be extracted. In the present exaninl!" ttdihlioiml fm-tom need to 

identically. In a practical nnihlo w cxiu't, the rt‘.sidual.s vaniali 

table should be computed and insnei!***^!* the residual 

factors should be extracted If that '« whether adilitional 

residual table as with the js Nimble, one proceeds with the 

Groups are then listed from the i“«-trix in tlie present example. 

»«to add on. or mor, colnmna to th. S r““ “ 
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In the present case we have one set of residuals to compute for the entire 
factor matrix F instead of several sets of residuals, as would have been re¬ 
quired in most of the current methods of factoring the correlation matrix. 

It will also be seen that the order of the inverse to be computed is equal to 
that of the number of factors determined by this process. For example, if 
seven factors are to be determined and if the process starts with seven linear¬ 
ly independent clusters, then there is an inverse of order 7X7 to be com- 
nuted. If the factoring proceeds with, say, only four groups, then there is 
an inverse of order 4X4 to be computed, and the fourth factor residuals 
should then reveal three additional groups, resulting in three columns to be 
added to the factor matrix F. The computational labor is probably mini¬ 
mized by finding as many groups in the given correlation matrix ^ there 
are common-factor dimensions, so that only one table of correlational 
residuals needs to be computed. However, if the first estimate of the nm- 
ber of clusters is too small, one merely repeats the process until the residuals 
vanish. If the factoring is done in several steps, the inverses are, of course, 

Tte^groSg was chosen quite arbitrarily in this example in order to il- 
lustrate^in a numerical example that the multiple group method of factoring 
is independent of the method of grouping the variables. The oidy require¬ 
ment is that the centroid vectors of the several groups must be linearly in- 

lufiSi necessary to select the same number of tests in each group, but 
there should be at least three or four tests in each group. This reqmrement 
is associated with the separation of the common factors from the unique 
factors. A limiting case is that in which each 

The multiple group method then degenerates into the diagonal method of 
factoring.* The multiple group method is not ^ 

might assemble a group of tests whose sum would give 
would then be necessary merely to alter the grouping. 

• L. L Thmtone, Thml (to Midi.: EdmrdB Bm., 

January, 1933), pp. 13-16. 



CHAPTER IX 

CONFIGURATIONS AND FACTOR PATl'KIlNK 
Interpretation of factorial structure 

We have seen that every correlation matrix implies a confiKurution of lest 
vectors and that the number of dimensions of the <!onliKuriitioii is the rank 
of the correlation matrix. It has also been shfiwn that a reference frame 
must be inserted in the configuration before a factor matrix can be written 
The combination of the configuration and tlie reference frame i.s called a 
‘structure.” The problem to be considered now i.s how to locate the ref 
erence axes in relation to the eoiifiguratiem so u.s to give the mo.st plausible 
interpretation for the reference frame. All students of the multiple-fantor 
problein agree that the reference axes shouhl b(i placed in some relation to 
the configuration, but they differ on the criteria by which thi.s should be ac¬ 
complished. These differences, which arc the .subject of considerable con- 
royersy, are due principally to the different purpo.sc.s of factor analysis 
which the several wnters have had in mind. Wliat is correct a„,l acceptable 
for one purpose may be irrelevant for another puriTo.se. 

he will investigator imtst dts-ide whether 

w f. variance of each 

test or only the common-factor variance. His choice will ilepend on his 

Ihe several methods of factoring are applicable in this ca-se, just as well as 
m the case where communalities are inserted in the diagonal cells. The fac- 
tor matrix will then represent a set of n unit te.st vcidom, which define the 

in general, (n-hr) factors or dimensions. The configuration will not involve 

be bTlSno T «“ “■""I”® 

nitaed bv the 'Mlora which are dolei- 

are mserteu m the diagonal cells of the correlation 
176 
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matrix. If there is reason to suspect that there is no unique variance in the 
measurements, then unity can be used in the diagonal; but such situations 
are rare in those fields in which factor analysis is likely to be most useful. 
With the communalities in the diagonal, we have the possibility that the 
number of common factors is considerably less than the number of measure¬ 
ments, so that the problem becomes soluble, at least as far as the number 
of unknown common factors is concerned. 

The purpose of a factor analysis also determines how the data are to be 
treated, even after a decision has been made concerning the self-correla¬ 
tions. The two conflicting purposes that are largely responsible for contro¬ 
versy in this field are (1) the statistical condensation of the correlations into 
a factor matrix with maximum effectiveness and (2) the interpretation of 
the factors which represent distinguishable functions or parameters. Ever 
since multiple-factor analysis was introduced, it has been known that these 
variant solutions are mathematically equivalent. The debate is concerned 
with the choice of reference frame for the factor matrix, which is the end- 
product of the computational work and the starting-point for interpretation. 
These two purposes may overlap when an investigator tries to accomplish 
both the maximum statistical condensation of the correlation coefficients 
into a factor matrix and also a physical interpretation of the factors as rep¬ 
resenting fundamental concepts or functions. Some students of factor anal¬ 
ysis deny that meaningful factors exist in psychological measurements or 
performances, at least when they are revealed factorially. In other contrats 
the gnma authors speak confidently about “auditory acuity," ' mechanical 
aptitude," “fluency," “visualizing,” and many other components of abilities 
and disabilities; but, when these same functions appear in a factor analysis, 
they promptly discard the psychological interpretations as foolish. For such 
authors an attempt factorially to identify abilities is supposed to be a for¬ 
bidden faculty psychology. 


Statistical criteria for the reference frame 

If the principal purpose of a factorial study is to condense the ihtercorre- 
lations into a factor matrix with a set of numbers that will account for the 
correlations, then we have a legitimate statistical problem that can be 
solved. In general, the factorial solution would be considered the more suc¬ 
cessful, the smaller the number of factors that account for the correlations 
with negUgible residuals. The statistical condensation is judged to be suc¬ 
cessful if the number of independent parameters in the factor matrix is v^ 
much smaUer than the number of independent correlation coefficients. By 
the usual statistical considerations the most acceptable factor matrix would 
then represent a reference frame that is caUed the prinapal a^es of the con¬ 
figuration of test vectors. It is located by a maximum aanonce critenm 
Some of the characteristics of the principal-axes solution will be mentioned 
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here. The first axis is so placed in the configuration that the sum of the 
squares of the projections of the test vectors on the fir-st axis is maximized. 
There usually exists a unique solution for a given test battery. When the 
first axis is so placed, the first-factor products account for more of the vari¬ 
ances of the n tests than can be accounted for by any other axis in the con¬ 
figuration. When the same criterion is applied to the first-factor residual 
coefficients, the second principal axis is so placsed that it aetcounts for more 
of the residuals than any other axis in the residual cf)nfiguration. The 
first two factors, then, account for more of the test variances than any other 
pair of axes in the teat configuration. For any given number of factors so 
extracted from the correlation matrix, the residuals arc minimized. This is 
an interesting and important feature of the principal axes of a test configu¬ 
ration. This reasoning may be applied to a correlation matrix with unity 
or with communalitiea in the diagonal cells. 

When the correlation matrix is large, say forty or fifty tc-sts, the prin¬ 
cipal-axes solution is quite laborious, and it is usually advisable to make 
some compromise. Another statistical principle that can be used for locat¬ 
ing the reference frame is to place the first axis through the centroid of the 
termini of the teat vectors for the whole battery. This axis is usually nearly 
the same as the first principal axis when the correlation matrix has coeffi¬ 
cients that are all positive or zero. This type of solution can also be made 
either for the total test space or for the common-factor space. With some 
modifications, the subsequent axes can be phuicd so as to accomplish es¬ 
sentially the same purpose for the residual coefficients after the extraction 
of each factor. This principle does not lead to a unique solution for any 
given test battery. Its purpose is essentially .similar to that of the principal- 
axes solution, in that one attempts to account for as much as possible of the 
test variances by each successive factor; but the centroid solution is not 
unique for any given test battery, and the solution does not have the in¬ 
teresting mathematical properties of the principal-axes solution. The cen¬ 
troid method of factoring and the centroid solution for the location of the 
reference axes are to be regarded as a computational compromise, in that 
they have been found to involve much less labor than the* pvinciipal-axes 
solution. The residuals after the extraction of a given number of factor.s are 
somewhat larger than the residuals remaining after the Htmu) number of 
factors determined by the principal axes. 

The two principles that have been described for locating the reference 
frame are both dependent on the whole conffguration. lOach Kuecc.sRivc fac¬ 
tor is determined by some criterion that is applied to the whole test con¬ 
figuration. These criteria we have called “statistical” in contrast with the 
configurational criteria for locating the reference frame which depend on the 
nature of the test configuration as determined by its distinguishable parts. 

When we apply statistical criteria for locating the reference frame, our 
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principal interest is in the size of the residuals, which are made as small as 
possible. Less interest is then ordinarily given to the factor loadings them¬ 
selves, although some writers make attempts to interpret the factorial axes 
located by these criteria. When the successive factorial axes have been lo¬ 
cated with the purpose of mi ni miz in g the residuals, the factor loadings 
are regarded more or less as regression coefficients, whose principal useful¬ 
ness is that they account for the dependent variable with the smallest 
possible residuals. In moat cases when a regression equation is written 
the principal concern is to predict the dependent variable with the small¬ 
est possible error, and little attention is then given to the interprets^ 
tion of the regression coefficients themselves. They serve ordinarily as a set 
of useful, but otherwise meaningless, numbers that do predict the dependent 
variable. In factor analysis we have no differentiation between independent 
and dependent variables, but we can apply statistical criteria to ascertain 
whether the several factors do account for the intercorrelations with mini¬ 
mum residuals. If this is the principal purpose of a factorial study, then it 
seems reasonable to expect the writer to show that he gains something which 
is not available in the classical statistical methods involving multiple corre¬ 
lation and regression equations. 

The statistical and the configurational criteria for locating a reference 
frame in the configuration of test vectors can be combined in what seems 
to be the ideal factorial study. If we disregard computational lalwr, which 
may be reduced by improvements in computational methods, the ideal solu¬ 
tion for a factor problem seems to be, first, to deteamine a set of r factors 
for the given correlation matrix which are so determined that the rth residu¬ 
al coefficients satisfy two requirements, namely, (1) that the residuals are 
the smallest possible for r orthogonal factors and (2) that they are small 
enough to be ignored. This implies the first r principal axes of the test con¬ 
figuration. When the solution has arrived at this point, we can be certain 
that the r factors account for more of the common-factor variances than 
can be accounted for by any other set of r orthogonal factors. The factor¬ 
ing should be made with communalities in the diagonal cells of the correla¬ 
tion matrix. The next step in the solution is to find a reference frame m the 
r-dimensional configuration which will represent the distinguishable func¬ 
tions or parameters of the tests and their conelations. When such a refer¬ 
ence frame can be found, it represents primary factors in the test variances. 
There is no guarantee beforehand that such a reference frame can e 
found. If the test battery is a hodgepodge of complex tests, there may not 
exist in the configuration any clues as to what the imderlying functions may 
be: but this possibility is dependent on the intuitions of the expe^enter 
in assembling a significant set of measurements rather than on factorial 

theory and method as such. - - . i • 

In this text it is assumed that the principal purpose of factor analysis is 
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to identify one or more underlying factors, funtitional uniti«'.s, or parameters 
that produce the differential performances or other individual dilTerenees, 
even if the discovery of such a factor or factors should account for only a 
part of the test vai-iances in any particular test battery, leaving considerable 
paits of the variances still unaceounted for and to be identiticd by future 

investigation. , 

If it should be found, for example, that the ability for serial learning is 
distinct from the ability to memorize paired associates, then siieli a tindiiig 
would be an important addition to our knowledge about the faculty (tr faciil- 
ties of memory, even if the serial-learning factor .should aeeoiint for only a 
part of the variances of the raemoiy t&sts involved. If it should lie found 
that serial leaiming and paired associates do not sepavati' fiu-torially, then 
we should conclude that, as far as we can ascertain now, tlii-sc two forms of 
recall are mediated by the same cortical function.s. TIk; tpicst i< m of whet her 
these factors account for all, or only a part, of the variances of tlie partieii- 
lar tests that we happen to use is, then, a secondary matter for the scien¬ 
tific problem. At the same time, wo should regard any unknown nwidiuil 
vaiiance as a challenge to further exploration cil her liy factorial or by ol her 
experimental mean.s. 

The parameters or functions in lorm.s of which a domain is tie,scribed are 
probably never unique, and this corresponds to (lit! fact llial no one ba.s 
ever demonstrated any factorial description to be uniipie. 'I'he best ihal 
can be said for any factorial description of a domain i.s lliat if revetds some 
aspects of an underlying order; but, in so fur as this j.s.succe.s.sfiilly done, it is 
likely to reveal alternative sets of paraiiicters or functions tliul might he 
chosen for the scientific de-seription. In the simple two-<limen,siomd example 
of the cylinders in chapter ii, this lack of uni(im!ne,ss of tlie factoritd re-solu- 
tion is easily seen, but it does not invalidate eitb(*r of the faetorial descrip¬ 
tions. The choice of fundamental axes would depend on tlie context, but it 
will be seen in the higher-dimensional problems liial (he common practice 
of taking a central or average factor for all the measiiremeiif s in any pari icu- 
lar factorial experiment as one of the basic paniim‘tcr.s for t he fl< tiiiain fends 
usually to blur rather than to clarify the underlying order. 'I’lie lack of 
uniqueness of factorial resolutions is in agreenusit. wit h I he jirinciplt* I lial a 
scientific hypothesis can never be demonstrated to In' etirrecf; it can only be 
shown to be plausible for the data at hand tir inconsistent wit li t hem. 

In the development of multiple-factor analysis one nafuiiilly raises the 
question as to whether the object is to aecount factoriully for the original 
raw test scores or the intercorrelations. Tlmsu two objeetivf'.s an* not the 
same. One might reproduce the intorcorri‘lalion.s with commuruilities by a 
factor matrix which would not enable us to reproduct* tht* raw .score.s. Smne- 
times this question is discussed as an issue in which wt* miglit make a choice. 
To analyze a set of raw scores so that they are reproduced factorially in- 
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volves more factors than can be solved for by present methods. Limiting 
the analysis to the common factors sometimes makes the problem soluble. 
By identifying one factor at a time and by building new test batteries for 
the exploration of unknown factors, we hope eventually to know enough 
about the factors involved so that the actual test performances themselves 
may be accounted for to an acceptable degree of approximation. That is the 
ultimate objective. Limiting ourselves to the common factors in each study 
is a means of eventually attaining the interpretation of the individual test 
performances. 

Considering factor analysis as a scientific method rather than as an effi¬ 
cient method of statistical condensation, we shall discuss different types of 
factors, configurations, and factor patterns to determine how they may be 
used in the discovery of an underlying order in the complexities of human 
traits or in other fields, where basic concepts may be formulated in terms 
of exploratory factorial investigation. 

Simple structure 

One of the turning-points in the solution of the multiple-factor problem 
is the' concept of "simple structure.” It will be shown that this concept 
enables us to obtain an invariance of factorial description that has not, so 
far, been available by other means. The combination of a test configuration 
and the co-ordinate axes is called a structure. The co-ordinate axes deter¬ 
mine the co-ordinate planes. If each test vector is in one or more of the 
co-ordinate planes, then the combination of the configuration and the co¬ 
ordinate axes is called a simple structure. The corresponding factor pattern 
will then have one or more zero entries in each row. If a test vector lies in 
one of the co-ordinate planes in a three-dimensional configuration, then it 
can be described as a linear combination of two co-ordinate vectors, so that 
one of its factor loadings is zero. If a test vector lies in two of the co-ordi¬ 
nate planes in a three-dimensional problem, then it is collinear with one of 
the co-ordinate axes, and it will have two zero factor loadings. If a test 
vector lies in all three co-ordinate planes in a three-dimensional problem, 
then it is a null vector with three zero factor loadings, and it is of no scien¬ 
tific interest. 

When a factor matrix reveals one or more zeros in each row, we can infer 
that each of the tests does not involve all the common factors that are re¬ 
quired to account for the intercorrelations of the battery as a whole. This 
is the principal characteristic of a simple structure. A simple structure and 
its corresponding factor pattern reveal that the complexities of the individu¬ 
al tests are lower than the compleaty of the battery as a whole. When a 
configuration reveals that the test vectors lie in restricted aubspaces, such 
as the co-ordinate planes, and in their intersections of still lower dimension¬ 
ality, this circumstance can be used for the location of a reference frame 
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that will generally give a simpler interpretation for the individual tests than 
if each test is supposed to involve all the factors of the whole battery. Must 
of the configurations and factor patterns in the following section are ex¬ 
amples of simple structure, in that generally the rows of the fact(3r niatricics 
have one or more zeros. The degrees of convincingness and overdelermina- 
tion of simple structure and the algebraic relations will be discussed in sepa¬ 
rate sections. 

Types of factors 

Factors are classified in several types according to the manner in which 
they enter into the test variances of a battery. A factor which is of a given 
type in one battery may be of another type when it enters into the tests of 
another battery. The classification refers, then, to the manner in whi<!h a 
factor is involved in a given teat battery. 

A factor which is involved in the vai-iances of two or more tests of a bat¬ 
tery is called a common factor in that battery. Our use of the tenn "com¬ 
mon factor” in this text implies that the factor is determined by the side 
correlations. We distinguish between common factors so dc'.tormincd and 
the unique factors determined by the diagonal self-correlations. Excep¬ 
tions to this use of the term will bo explicitly noted. 

A factor which is involved in the variance of only one ti-st of a battery is 
a unique factor in that battery. 

A common factor which is involved in the variancc'.s of all te.stH in a bat¬ 
tery is a general fodor in that battery. 

A common factor which is involved in the variances of two or more, but 
not in all, of the tests of a battery is sometimes called a groivp factor in that 
battery. 

A common factor which is involved in the variances of only tw'o tests in 
a battery is called a doubUt. 

A common factor which is involved in the variances of only three tc.sts 
in a battery is called a triplet. 

A factor which enters into the test variances of a battery with both posi¬ 
tive and negative signs is a bipolar factor. 

Types of configurations 

All the configurations discussed in thm .section are. tliree-diincnsionjd. 
The principles illustrated here can be generalized to conligural ions in n 
dimensions. 

Random configuration 

In Figure 1 we have three orthogonal axes, 7, 77, and 777, which detei’- 
mine the right spherical triangle shown. The points represent normalized 
test vectors. The test vectors in this figure show a random configuration, 
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which gives no clue as to factorial composition. Hence the cells in the cor¬ 
responding factor pattern are, in general, all filled. Both positive and nega¬ 
tive factor loadings are then found in the factor matrix. This is illustrated 
in factor pattern 1. 

Cone configuration 

In Figure 2 we have a cone configuraiion, in which the normalized test vec¬ 
tors all lie in a cone with a 45° generating angle. The intercorrelations for a 
cone configuration are all positive or zero. So far, the cone configuration 
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has been of only theoretical interest, and it is included here to bring out 
the fact that, although the correlations are all positive or zero, the load¬ 
ings for orthogonal factors cannot all be positive or zero. This is illus¬ 
trated in the figure in which the cone configuration cannot be inclosed 
within the three orthogonal co-ordinate planes. If the rank of the correla¬ 
tion matrix is 2 or 1 and if the correlations are all positive or zero, then a 
factor matrix can be written in which all the loadings are positive or zero. 
When the rank of the correlation matrix is 3 or higher, then a positive fac¬ 
tor matrix does not necessarily exist. However, in practice it is usually pos¬ 
sible to write a positive factor matrix when the correlations are positive or 
zero because the test configuration is rarely, if ever, cone-shaped. 
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Isolated constellations 

In Figure 3 we have a set of three constellations or clusters of test vec¬ 
tors. In Figure Sa the clusters aie shown at the co-ordinate a.vc8, I, II, 
and III. When the clusters are separated by acute anglc-s, the clusters are 
correlated, and the co-ordinate axes would then be oblique if they were 
passed through the center of each cluster. The factor matrix Sa .slicnvH a 
simple structure with complexity 1 for each test; but, if the factors are cor¬ 
related, this circumstance is interpreted to mean that the three factors 
themselves have some second-order factor in common. For example, visual 
and auditory acuity might be two factors in terms of which test.s may be 
described, but these two factors might themselves be correlated by some 
second-order factor, such as general physical fitness or age. 



In Figure Sb we have a different structure and consequently a difftirent 
factor pattern for the same configuration of three clusters. Here axis I is 
placed in the middle of the configuration, and one of the clusters has btjcn 
placed in the plane I-II. The other two clusters are then nece.saarily one 
positive on III and the other equally negative on III. One cluster is a 
function of only two factors, namely, I and II, while the other clusters in¬ 
volve all three factors. Factor pattern Sb is not likely to reveal so much 
about the underlying functions as is pattern Sa. 

The isolated constellations or clusters constitute one of the most easily 
recognized of all the types of simple structure. It can usually be seen by in¬ 
spection of the correlation matrix when such a configuration is present. The 
tests within a cluster have relatively high intcrcorrelation.s, while t(!.sts from 
different clusters have much lower intercorrelations. The differentiation of 
constellations was the first type of multiple-factor pattern to be investigat¬ 
ed, and it is the simplest form of configuration, since each test then has unit 
complexity. 

Complete triangular configuration 

A three-dimensional configuration sometimes shows the test vectors to 
lie in three distinct planes, as shown in Figures ^a and Jfb. In the simple 
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structure and factor pattern of Figure 4a there are both positive and nega¬ 
tive factor loadings because the configuration extends beyond the triangle 
of the three co-ordinate axes. In the simple structure of Figure 
4b there are only poisitive factor loadings because the teat vectors are con¬ 
fined to the positive right spherical triangle. The test vectors in the plane 
I-II arc de.S(!ribed as linear combinations of two factors, and the third- 
factor loadings are then zero. It will be noticed that all the tests in the tri¬ 
angular configuration have a complexity of 2, except those which lie at the 
corners of the configuration, which have unit complexity. 
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Incomplete triangular configuration 

It docs not usually happen in e.xploratory studies that all the co-ordinate 
planes are defined by the configuration. In the three-dimensional ease of 
Figure 5 we have a simple structure in which only two of the co-ordinate 
planes are defined by the configuration. These are the co-ordinate planes 
I-II and I-III. If the fans of test vectors in the planes I-II and I-III 
extend over right angles and if the dihedral angle at 7 is a right angle, the 
location of the three orthogonal axes as shown would be fairly convincing, 
even though the plane 77-777 was not defined by the configuration. In 
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such a situation one would try to find an interpretation for the factors II 
and III to determine whether there is some good reason why they should 
not have combined in some of the tests so as also to produce a fan in the 
plane II-III. New tests might be constructed in which these two factors 
are involved and a new factor study made to asccrtmn whether the inter¬ 
pretation of factors II and III can be sustained by the appearance of a fan 
of teat vectors in that plane. The present example includes only positive 
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factor loadings, but the same general type of reasoning can be extended to 
simple structure with negative factor loadings, as will bo shown in other ex¬ 
amples. 

If the dihedral angle at I is not a right angle, the inference is made that 
factors II and III are probably con-elated, either positively or negatively, 
depending on their exact locations. If the fans of test vectors from the first 
axis do not extend to a full right angle, as shown in Figure Sb, then the loca¬ 
tion of the co-ordinate plane II-III is indeterminate. It might be assumed 
to be orthogonal to J, or it might be placed in the oblique position II'-III', 
as indicated by the test vectors in the two planes. But such a situation may 
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ments may show us to be wrong, as the fundamental ideas of a science are 
modified or replaced by more embracing conceptions. What is a discovery 
of interest and importance in one generation becomes inadequate or even 
wrong in the next generation. There is little use in belaboring thi.s limita¬ 
tion, which is universal for all science. Those re.scrvations will bo taken for 
granted throughout our discussion of factor analysis as an aid in scientific 
exploration. 
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General and group factors 

Since factor analysis was dominated for a quarter of a century by the cen¬ 
tral theme of a single general intellective factor with otlujr fac.tors regarded 
as “disturbers’’ of secondary importamio, it is of interest to see perhaps the 
simplest form of general factor in a configuration. One typo of (jonfigura- 
tion involving a general factor in a battery is shown in the -structure of Fig¬ 
ure e. The simple structure is incomplete in that only two of the co-ordinate 
planes are defined by the configuration, namely, I-Il and I-lII. Note also 
that all the test vectors have positive projections on the first axis, so that 
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the first column of the factor pattern is filled. All the correlations would be 
significantly positive. The rank of the correlation matrix would be 3. 

The plane II—III is not defined by the configuration in the structure of 
Figure 6a. Some students of factor analysis prefer to locate the reference 
frame for a configuration of this type as shown in Figure 6b. They place 
the first axis centrally in the configuration, so as to maximize the projections 
of the first factor, as shown. The location of orthogonal axes II and III 
can then be made by one of several statistical criteria. The corresponding 
factor pattern is then, in general, filled as shown, the second and third fac¬ 
tors being both bipolar. The resolution of Figure 6a is the simpler and more 
readily interpreted, but the first-factor saturations are not maximized. 

When a configuration is found such as that of the two figures, 6a and 
6b, there is some uncertainty in the interpretation of all three of the fac¬ 
tors. The second and third factors may not exist in the absence of the first, 
or they may be correlated with the first factor, in which case the structure 
would be oblique. The first factor is defined by its presence in all tests of 
the battery; but it would bo interpreted more clearly if we could predict 
with assurance the tests in which it is absent, as well as the tests in which it 
is present. A new factor experiment should then be made with a variety of 
teats, in which it is predicted that the first factor should be al;)sent but in 
which one or both of the other two factors should be present. The simplest 
and clearest result would be to find a complete triangular structure with a 
group of testa in which the first factor is absent. If the predicted configura¬ 
tion is obtained, one has more assurance in the interpretation of the factors 
than if the factorial result is left as in Figure 6. Whatever the general factor 
is in a particular battei'y, its nature is better understood if we can predict 
with confidence the tests in which it is absent, as well as the tests in which, 
it is present. Since factor analysis was for so many years primarily con¬ 
cerned with the single general factor and with correlation matrices of rank 1, 
the procedure here suggested is stijl avoided by some investigators, even 
though it is indicated when the problem is regarded from the point of view 
of multiple-factor analysis. 

Bipolar simple structure 

The concept of simple structure implies that the test vectors lie in the co¬ 
ordinate planes, or hyperplanes; but it does not imply that the factor load¬ 
ings are all positive, as this concept is often misstated. By way of example, 
Figure 7 has been drawn to show one bipolar factor and two positive factors, 
whose saturations are all positive or zero. It is factor I, which here is bi¬ 
polar. A configuration such as that of Figure 7 would be interpreted as 
showing that factor I combines either positively or negatively with III but 
that it combines only positively with II. The figure shows only one of a 



190 MULTIPLE-FACTOR ANALYSIS 

great variety of configurations in which positive and bipolar factors can be 
combined. 

Dependent composite factor 

Occasionally, but not often, it happens in analyzing e.\perimeiital data 
that the trait vectors define a secondary plane or hyperplanc, as .shown at 
II-A in Figure 8 for a three-dimensional configuration. ■When a secondary 
plane like this appears in the configuration, the interpretation is likely to be 
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of special interest. The test vectors in the secondaiy plane II~A can be de¬ 
scribed as linear combinations of /, II, and III, whore I and III always en¬ 
ter into the tests in the same ratio. The configuration of the figure would 
mean that whenever I and III combine with II, then I and III enter the 
measurement in some fixed ratio. The test vectors in the three bounding 
co-or^nate plmes are all linear combinations of only two of the factors. A 
situation like this should not be ignored when it is found in experimental 
aata. it may be suggestive for some fundamental concepts in the domain 
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The factor pattern 

The factor pattern has been defined as a factor matrix in which are re¬ 
corded the non-vanishing cell entries denoted X and the v a ni s hing entries 
which are left blank. When a differentiation is to be made between positive 
and negative factor loadings, the non-vanishing entries are denoted -1- or —, 
while the vanishing entries are blank. For the interpretation of factorial re¬ 
sults the factor pattern is sometimes of greater importance than the numeri¬ 
cal values of the factor loadings. It is sometimes important to know about 
an unknown factor or function that it is present in certain tests and absent 
in certain others, or that it enters positively (as in a numerator) in some tests 
and negatively (as in a denominator) in certain other tests. In fact, it is 
more significant to know the factor pattern in this way than it is to know the 
actual numerical values of the factor loadings, because the numerical values 



Dependent comporite factor 


are determined by such irrelevant matters as the metric, the numerical 
scales in terms of which the measurements were made, and the decision of 
the investigator to reduce the measurements to correlations or to leave them 
in the form of covariances. It will be shown that certain fundamental forms 
of invariance in factor analysis relate to the invariance of the factor pattern. 
Not all these forms of invariance are applicable to the numerical values of 
the factor loadings. 

The factor pattern can be regarded in two different ways during a factor 
analysis. It can be set up as a hypothesis at the beginning of an analysis, 
and the factoring may be carried out with a specified pattern in mind, or the 
factor pattern can be inferred from the configuration when the factoring has 
been completed. Some writers postulate a pattern in which the first factor 
shall be positive, leaving the subsequent factors bipolar. It is probably 
better to factor a correlation matrix and then examine the configuration 
before choosing an appropriate factor pattern. The examples of this chapter 
serve to illustrate the relations between the configuration, the^ choice of 
reference frame, and the resulting factor pattern. The principles illustrated 
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in thsse exEtniples can bo generalized to configurations in any number of di¬ 
mensions, 

Some of the controversy about the general factor is caused by the insist¬ 
ence of some writers that there must bo a general factor, even if it is only an 
average of the test vectors in a battery whose correlations are positive or 
zero. In order to illustrate this situation in three dimensions, we have drawn 
Figure 9, which shows a set of teat vectors in a complete triangular configu¬ 
ration. When these are plotted on a sphere, the location of the reference 
frame, as in Figure 9a, is compelling and convincing. Instead of placing 
the reference frame in relation to the configuration, some writers place the 
first axis at 7, as shown in Figure 9b, because this location is central for the 
whole battery and maximizes the test vector projections. The other axes 




AUemalive locations of first reference axis 

are placed orthogonal to the first central or average axis, and they take posi¬ 
tions like II and III outside the configuration so that they necessarily be¬ 
come bipolar. It is still possible to identify the more fundamental factors, 
A, B, and C, after a central axis has been placed in the configuration be¬ 
cause, as is to be expected, the first-factor residuals will be largast for the 
tests near the corners of the triangle, and these are the te.st.s that primarily 
identify the factors. One type of factorial intorprctaticjii that i.s rather com¬ 
mon can be illustrated in Figure 9b. The third factor would have po.sitive 
saturations on the testa near B and C, while it would have negative satura¬ 
tions on tests near A. Such a result is sometimes interpreted to mean that a 
factor such as III in Figure 9b is a "complex relationship” of some kind. 
If these writers could only be induced to plot their configurations and look 
at them, there would be less insistence on placing the first axis centrally in 
the configuration, and the factors would often jdeld to rather simple psy- 
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Oblique axes 

In previous cliapters we have considered the rotation of axes in ctniligura- 
tions that could be completely visualized on a diagram in two dinumsioiis 
or on the surface of a sphere in three dimensions. In actual data the dimen¬ 
sionality nearly always exceeds three, so that the configuration cannot bo 
completely visualized in a single diagram or model. The rotation of axes 
is then determined by two-dimensional sections, one .section for each pair 
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of co-ordinate axes, or by three-dimensional scetioiw of llic miillidimen.sion- 
al configuration. A four-dimensional configuration is represented by .six dia¬ 
grams when two-dimensional sections are used. A configuration of ten di¬ 
mensions has forty-five such sections, since this is the number of pairs of 
co-ordinate axes. 

In this chapter we shall use as an example a three-dimensional configura- 
tion with twenty test vectors. This example is used for illustrating several 
me 0 s 0 rotating the axes, namely, ( 1 ) by plotting the normalized vec- 
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tors on a sphere, as shown in a previous chapter; (2) by two-dimensional 
sections, as will be shown in this chapter; and (3) by three-dimensional sec¬ 
tions in the method of extended vectors, which will be described in chap¬ 
ter xi. 

We start this problem with a factor matrix Fo in which w=20 and j'= 3, 
as shown in Table 1. The columns of this matrix represent three arbitrary 
orthogonal axes as determined by the factoring method. These three axes 
are denoted T, II, III^ and they will be referred to by the subscript m, as in 
previous chapters. These arbitrary orthogonal axes, as well as the test con- 





figuration, will be regarded as fixed in position, and oui‘ problem is to select 
by successive approximations another set of axes for which we hope to find 
scientific interpretation. The new set of axes will be called reference axes, 
and they will be denoted by the letters A, B, C, etc., to distinguish them 
from the fixed orthogonal frame I, II, HI- 

In starting the rotational problem we locate the unit reference vector A 
in the orthogonal axis I, the reference vector B in the orthogonal axis II, 
and the reference vector C in the orthogonal axis III. This is shown in 
Table 1 and in Figure 1. The initial location of the reference vectors will be 
denoted Ai, Bi, Ci, and they will be identified by the subscript u. Their 
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direction cosines are shown in the matrix Aoi witii elements X„„, jis shown 
in the rectangular notation; 



Ai 

lit 

Ct 

I 




II 
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III 
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Aoi with elements Xnu 


The subscripts of Aoi show that the columns of this matrix give the direc¬ 
tion cosines of the initial locations (1) of the unit reference vectors with re¬ 
gard to the axed orthogonal frame (0). Tho subscripts of refer to the 
axes of the hxed orthogonal frame (m) and the given positions of the ref¬ 
erence vectors (m). 

For each rotation we denote the given positions f)f tho reference vectors 
A 1 , Bi, and Ci. By inspection of the conagurations in Figures 1,2, and 3, we 
detemune the adjustments to be made in these vectors. Their new posi¬ 
tions are denoted At, Bt, and Cj. After the hrst rotation the plots repre¬ 
sent oblique axes, so that the true lengths of tho vectors are not immedi¬ 
ately evident. The adjusted vectors are therefore iimt (lot(»nninr!d as to 
their direction. They are then called long reference vectors and deiujted A^, 
B'^, and C;S. When they have been reduced to unit length, they constitute 
the new unit reference vectors, At, Bt, and Cj. For each adjustment of the 
reference vectors we have, then, two steps in computation. Starting with 
the given unit reference vectors A,, Bi, Ci, we determine, first, the long 
reference vectors Aj, B^, C^, which give the desired dii'cctions. Second, we 
determine the lengths of these vectors, so that they can be reduced to the 
new unit reference vectors At, Bt, Ct. 

The projections of the test vectors on these axe.s are then computed, and 
a new set of plots is made. By inspection of these plots the next adjust¬ 
ments are determined by inspection. In the computations for the second 
rotation the given unit reference vectors are denoted Aj, Bt, C',, and their 
newly adjusted positions are denoted A», Ct. In this manner we avoid the 
we of n^umencally lap subscripts, say 10 or 16, for as many rotations. 
±01 each rotation of the reference axes, the given positions are indicated by 
the subsenpt 1 and the new positions by tho 8ub.S(!ript 2. 

The given reference vectors will be indicated by the subscript u. The 
new long refepce vectors for each rotation will be indicated by tho sub¬ 
senpt r, and the new unit reference vectors by the subscripts p and g. 

lai, 1 columns, and each point is 

labeled with the number of the corresponding test vector. The points in 

t^ figp show the conpration of test vector termini as they would ap¬ 
pear when seen along a line of regard orthogonal to the plane of AiS,. The 
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two axes Ai and By are in the plane of the diagram. If the axis A 1 is moved 
in the plane AyByto the direction of AJ, it will determine a plane (or a hy¬ 
perplane if 3) which vdll intersect the plane AiBi in the line which is 
marked A-plane. This line is a trace of the plane, or the hyperplane. The 
vectors 1, IS, and IS will then have vanishing projections on the vector Aj. 
In the same manner the given position of the axis B, which is denoted By, 
can be moved in the plane AiBi to the direction of B^. Orthogonal to this 
vector is the B-plane, as shown. When the axis Si is so moved, there will 
be a group of test vectors with small or vanishing projections on Sj. 

In TaJ)le 2 we have summarized the computations for rotating the refer¬ 
ence axes. Each step in the computations will be described in detail for the 
first rotation, but the computations will be summarized only for the subse¬ 
quent rotations. The purpose of the rotations is to maximize the number of 
test vectors with zero projections on the reference axes. The given vectors, 
Ai, Si, and Cy, are represented by the rows of the 3X3 matrix, Sis, with 
elements s„r. The three columns represent the new long reference axes, 
here denoted A'^, B'^, C'^. The vector Ai is to be changed to the vector Aj, 
which is orthogonal to the A-plane. The vector AJ is a linear combination 
of A 1 and B y. It can be expressed in the form 

(1) Ai = 1.00A,-1-.90Bi, 

as read directly from the diagram of Figure 1. 

In the same figure we determine RJ, which is normal to the trace, 
S-plane, as a linear combination of Ai and By. It is read graphically as 

(2) B'i = . 6 OA 1 - l.OOBi. 

The directions of Ai and of Bi are so chosen that the majority of the 
twenty points have positive projections. 

The coefficients of these two equations are entered in the columns of 
matrix Sy 2 of Table 2. The columns of that matrix show the direction num¬ 
bers of the new vectors as linear combinations of the given vectors. Two of 
the columns of that matrix are determined graphically from Figure 1. 

In Figure 2 we have plotted the given columns Ai and Cy froni Table 1. 
In this figure we see the opportunity to move the vector Cy to Ci, orthogo¬ 
nal to the C-plane, whose trace passes through a group of points. The new 
vector can be expressed as a linear combination of Ai and Cy, namely, 

(3) Ci = .40Ai - l.OOCi, 

as determined graphically, and the coefficients of this equation are entered 
in the third column of the matrix S 12 of Table 2. Here, again, the new vec¬ 
tor CJ is drawn in such a direction that the majority of the points have 
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positive projections on CJ. Figure 3 was plotted from columns B and C of 
Table 1, but this figure was not used in this rotation of the reference frame. 

The first step in the rotation of the reference axes is to determine graphi¬ 
cally the numerical entries in the matrix jSfia with elements Su,. The sub¬ 
scripts of tSia indicate that this matrix shows the adjustments in the ref¬ 
erence vectors from position 1 to position 2. The elements Sur represent the 
relation between the given unit reference vectors, it, and the new long ref¬ 
erence vectors, r. 

In order to determine the true lengths of the long reference vectors A^, 
B 2 , C 21 they should be refei'red to the given orthogonal reference frame. 



Figubb 2 


This frame is actually repre.sented in Ai, Bi, and Cj of the first three fig¬ 
ures, but it is not so directly represented in the diagrams for subsequent ro¬ 
tations. Let a matrix Lm, with elements l„r, represent the long reference 
vectors r in terms of the fixed orthogonal frame m. The subscripts of Lm 
indicate that the long reference vectors in the second position are expressed 
in terms of the fixed orthogonal frame (subscript 0). 

The columns of the matrix Aoi with elements Xmu show the direction co¬ 
sines of the reference vectors in their positions 1. Since the initial positions 
of the reference vectors are in the fixed orthogonal frame, we have Ai in 
the axis I, B, in the axis II, and C, in the axis III, so that Aoi is an identity 
matrix. The elements of the matrix A are denoted when it represents a 
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set of reference vectors before adjustment. The elements of A. are denoted 
when it represents the reference vectors after an adjustment has been 
made. 

Let Aos be a matrix with elements Xmp whose coluniTis show the direction 
cosines of the reference vectors in their secr)nd p«)sitions. 'I’he colunuvs of 
this matrix show the direction cosines of the unit referenccj vectors p in the 
second position, expressed in terms of the fixed orthogonal frame 711. 



Fiauai; 3 


In order to determine the true lengths of the long refcrcn(;e vectors AJ, 
B'i, and Cj, we describe them in terms of the fixed orthogonal frame. We 
then have 


(4) 


= L 


I 


which can bo written in the rectangular form 


(5) 



Ai 

B. 

C, 


Ai 

B5 

Ci 

= 

Ai 

Bi 

<■’1 

I 

1 



A, 

1.00 

.50 

.40 

I 

1.00 

,50 

.40 

II 


1 


B, 

.00 

-1.00 

— 

II 

.90 

-1.00 

— 

III 



1 

Cl 

— 

— 

-1.00 

HI 

— 

— 

-1.00 


Sur l„r 
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In the matrix we have the vectors Ai, S,, and Ci expressed in terms of 
the orthogona,! umt reference vectors I, II, III. In the matrix we have the 
new vectors Aj, Bj, and expressed in terms of the given vectors Ai, Bi 
and Cl. The matrix multiplication gives the product matrix with elements 
Lr, m which the long reference vectors A', B'„ and C[ are also expressed in 
terms of the fixed orthogonal unit reference vectors. The matrix is a 
unit matrix for the first rotation. Consequently, and l„r are here iden¬ 
tical, but they will differ for subsequent rotations. 

The matrix equation can also be written in the form 


(fi) A01S12 = Loa, 

wheie the columns of Z 102 show the direction numbers of the long reference 
vectors in position 2 in terms of the fixed orthogonal frame. 

Since the columns of Lqi in Table B show the projections of the long vec¬ 
tors on the fixed orthogonal reference frame, we can determine the true 
lengths of the vectors AJ, Bj, and Ca- The sum of the squares in each col¬ 
umn is written 

I 


o T, m ore briefly, as SP on the data sheets. The square root of each sum is 
V2P, and it is the length of the vector r. The reciprocal is 


(7) 



The values of drp may be regarded as the elements of a diagonal matrix Da. 

The next step in the computations is to reduce the long reference vectors 
to unit length. This is done by the relation 


( 8 ) 


^ln,4r 


or, in matrix form, 


(9) 


LaiDi = Aoa f 
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which can be written in rcctiinguhir form: 

( 10 ) 

^'5 A™ 



The oblique factor matrix wliirli is the result f»f this rotation can now be 
computed by the equation 


m 

or, in matrix form, 

(^^) /'*oAo 3 “ Ys , 


where Fg ia the given factor matrix and Fj is the oblique factor matrix. This 
is the factor matrix in its second position. If the rotation <if reference axes 
were limited to orthogonal tran-sformatioas, wc alioulti have 

(13) /-'oAoj = Ft, 


where Fa would show the projections of tiie test v(;t!tms on a ne.w set of 
orthogonal axes. 

If it is desired to compute each factor matrix V from the just preceding 
actor matrix, instead of making the computations at each rotation from 
the original orthogonal factor matrix Fg, then we use the transformation 
matnx mstea,d of X„p. The columns of the matrix // with elements /»., 
show the new unit reference vectors A 2 . ffa, and C, in tenns of tl.e pre.-eding 

reference vectors and r’,. Wo then have. 


(14) 




^ur^irp “ /l|i 


or, in matrix form, 
(15) 


SiaDa = Hia 
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or, in rectangular form, 
( 16 ) 


Ai 

S12 

Bi 

Cl 


Ai 

Ds 

B, 

c, 

ss 

Ai 

ffii 

Cl 

1.00 

.50 

.40 

Ai 

.743 



Ai 

,743 

.447 

.371 

.00 

-1.00 

— 

Bi 


.894 


Bt 

.669 

-.894 

_ 



-1.00 

Ci 



.029 

Cl 

— 

— 

-.928 


hup 


The oblique factor matrix Vi can be determined from the preceding 
factor matrix Vi by the transfoimation We then have 

(17) = Vi. 

The rotational problem starts with the factor matrix Fa with elements 
a,„„ which give projections of the test vectors j on the fixed orthogonal 
frame m. The first step is merely to assign the initial locations of the trial 
reference vectors in the orthogonal axes of the fixed frame. This is repre¬ 
sented by the transformation 


FqAqi = Vi , 

in which Aoi is an identity matrix. The first rotation represents the inde¬ 
pendent adjustments of the reference vectors from their initial positions in 
the fixed axes. This adjustment is represented by the equation 

F oAoj = Vi, 

in which the columns of A 02 give the direction cosines of the new reference 
vectors in terms of the fixed orthogonal vectors m. The axes of Vi are then, 
in general, oblique. 

The second rotation is represented by the equation 

F oAoa = Vi, 

where the columns of Aoj show the direction cosines of the adjusted refer¬ 
ence vectors. The oblique factor matrix Vs can be obtained from the next 
preceding factor matrix, 72, if desired. The relation then is 


Vsffis = Vs. 
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The cosines of the angles between the now reference axe-s should be de¬ 
termined, to make sure that no pair of them is approuching anotlicr pair so 
closely as to represent practically the same factor. If that should happen, 
the dimensionaUty of the oblique factor matrix would be reduced so that 
the columns would be linearly dependent. It would then bo ueco.ssaiy to alter 
the location of one or more of the reference axes. ith a lit tle pi ai tire this 
error can be avoided. The cosines of the angles between the ixforonce vci;- 
tors are determined by the cross products 


( 18 ) 



Cpq 


or, in matrix form, 

(19) A'A = a . 

After the first rotation we have 

( 20 ) — Ci. 

It is useful to record these cosines on the corresponding diagrani.s for the 
next rotation, so as to avoid moving any pair of rcfcrciico vciitons so close 
together that a dimension is lost. The diagonal values of A'A must be unity, 
since unit vectors are involved. 

The successive steps in the computations for the finst rotation am .shown 
in TcAle S, and they can be summarized a.s follows: 

1) Write the elements of the matrix Sn by inspeclion of tlm plots for 

Yi. 

2) Perform the matrix multiplication 

(6) Aoi^i* = Loa, 

where Aci is a unit matrix for the fimt rotation. 

3) Determine the stretching factors dr, from the .sums of sriuarns in col¬ 
umns of Loa. 

4) Compute elements Xm, of Aoa by the equation 

(9) TjoiJii = Aoa. 

5) If it is desired to compute the oblique factor matrix, Vj, from the next 
preceding factor matrix, 7i, then compute tlie elements hu, in the matrix 
Hn by the equation 


( 15 ) 


SiaDa = Hit ■ 
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6 ) Determine the cosines of the angular separations of the new unit refer¬ 
ence vectors by the equation 

( 20 ) AqsAqj = Ci . 

7) If these cosines are acceptable, compute the new oblique factor ma¬ 
trix, Vi, by either of the two following equations: 

a) In terms of the original factor matrix, we have 


( 12 ) 


FftAos ~ Vi, 


b) In terms of the preceding factor matrix, we have 


(17) 


VtHii = Vi . 


In the fii'st rotation the initial factor matrix, V i, is identical with Ft, which 
is the initial factor matrix obtained from the experimentally determined 
correlation matrix. The matrix Fa is shown in Table S. 

8 ) Plot a new set of diagrams for all pairs of columns of Fa and examine 
them to determine the adjustments, which will be the next rotation of 
axes, 

It may be helpful to visualize in a single table the computations that are 
summarized in Tables S-7, inclusive, for the several rotations of the refer¬ 
ence axes in the present illustrative problem. The formulae have been ar¬ 
ranged in order of computation and in a separate column for each rotation. 
The subscripts indicate the rotatioia to which the formulae belong. The 
same schema can be extended, of course, to any number of rotations. 


Computational formulae for three rotations 

Given the factor matrix Fo=Fi as obtained from the correlations and 
the identity matrix Aoi. 


Aotalion 8 

Determine Sj 4 graphically 
A03S34 = Loi 


Ilotaiion t 

Determine iSu graphically 
A 01 S 18 = I '02 
Di from Los 
[SisDs = //is] 

LooDi “ Aos 
AosAos = Ct 
ViHii = 7 s 
or 

FoAos — Vi 
(In first rotation these two 
formulae are identical) 
Plot pairs of columns of Fs 


Holalion B 

Determine Ss 3 graphically 
Assess = Lo3 
Di from Lo 3 
[^soDa = Hit] 

LiiDt = Aos 
AoaAoa = Cj 

ViHi, = V, 
or 

iFoAos = 78 

(These are two alternative 
formulae) 

Plot pairs of columns of 7 3 


Di from Loa 

[SliDi = // 34 ] 

LiiDi = Ao4 

A04A04 = Ci 
ViHn = 74 
07 ’ 

F 0 A 04 =74 
(These are two alternative 
formulae) 

Plot pairs of columns of Vt 
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It should be noted that the matrix product of tlic soveral transformations 
H is equal to the transformation A for the same rotations. We then have 

(21) HaiHiiHitHzi = Aoi > 

where the transformation jffoi=Aoi= I. The transformation Kp carries a fac¬ 
tor matrix y„_i to the next factor matrix while the traii-sformation Ao, 
carries the original factor matrix Ft, to the oblique factor nmti-ix Vn. In gen¬ 
eral, the computational labor is least when the oblique factor matrix is com¬ 
puted by the transformation H; but if a matrix-multiplying machine i.s avail¬ 
able, the computations are performed best by the transformation A. 



The result of the first rotation of axes is shown in the next thr(!e figures 
4-5), where pairs of columns of Vt are plotted as before. It should be noted 
that, while the reference axes are now oblique, they are ncporthdcss plotted on 
orthogonal co-ordinate cross-section paper, as indicated in the figures. The 
procedures here described do not require that the plots be aidually made 
with oblique axes on the graphs. 

In stating each new rotation we denote the previous axes with the sub¬ 
script 1 and the new axes with the subscript 2. In Figure 4 we have plotted 
the columns A and B of Table S. The vector B, is moved to the position B^, 
so that the trace of the R-plane goes through a group of points S, 15, BO, 6, 
9, IB. The new vector B'^ is described from the graph by the vector equation 

(22) Bi = l.OORi -h .lOA,. 
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In Figure 5 we have plotted the columns A and C of Table S. A radial 
trace for a new A-plane can be drawn, as shown, with the normal Aj. Such 
a move of the A-axis will not only retain the zero, or near-zero, projections 
of 1, IS, and 18, which are at the ori^n, but will add six more tests to the 
list of negligible or zero projections on the A-axis. The new reference axis 
Aj can be expressed as a linear combination of the axes Aj and Ci of Figure 5. 
This relation is 

(23) Ai = l.OOAi - .72Ci. 

In the same diagram we see the opportunity to move the C-plane so as to 
obtain zero projections not only for those tests which are shown at the 



origin but also for the group 3, B, IB, SO. The normal to the (7-trace is C^, 
which can be written in the form 

(24) Ci = l.OOCi + .26Ai. 

In Figure 6 the trace of the C-plane is drawn radially so as to include the 
group of tests 1, IS, 18, and its normal is Ci, which is written 

(25) Ci = l.OOCi - .12Bi. 

In the same diagram the trace of the R-plane is drawn radially so as to pass 
through the group S, H, 19, and the normal is written 

(26) Bi = l.OOBi - .20C, . 
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The numerical values in equations (13)-(15) are entered in the »S'a3-matrix 
of Table 4 . Here it will be noted that a new process has bc?en introduced, 
namely, the combination of movements of a plane from more than oiitj dia¬ 
gram. The new vector is determined here (w a .sum of three vectors, 
namely, the previous B vector plu.s two correetion.s, namely, +.IOA 1 , and 
-.20(71. In a similar manner, the new vector Cj is determined by two cor¬ 
rections added to the previous vector C, namely, -t-.2r)Ai and — .12/ii, as 
shown in the columns of Sm in Table 4- 

In combining several corrections in the same rotation it i.s useful to re¬ 
member that the corrections should not be large—say, not over .30. If a 
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rotation whose sine is greater than about .30 is indicated on a diagi-arn, it 
should be token singly for that rotation. If several small rotations are indi¬ 
cated on the diagrams, they may be combined if they are independent. The 
independence of two small rotations cun be seen in the i)r<;.st!ut examples, 
The new vector is determined by two corrections from Figures 0 and 6 . 
In Figure 5 the trace of C is moved toward the grtnip 3, ;j, Iff, 20, and these 
are near the origin in Figure 6 . In Figure G the trace of (J is moved toward 
the group 1,13,18, and these are near the origin in Figure f). Hence the two 
movements can be combined. If a trace can be moved toward a certain 
group of tests in several diagrams, the move is made on only one diagram, 
for otherwise there would be an overcorrection. Another useful principle is 
















Matrix iS'ii 

Sur 

AniSii^ Ii«i 

mr 

D, 

3uDi=>IIu 

Jhp 

LoiOt^Aoi 

Amp 

Aq 3 Ao 1 *"C) 

<PJ 


Table 4 


Rotaiion 3 



Ai 

Bi 

ci 

A , 

Cl 

1.00 

- .72 

.10 
1.00 
- .20 

.25 

- .12 
1.00 


.28 

.00 

1.13 



Ai 

Bi 

ci 

1 

II 

III 

.476 

.660 

.668 

.447 
- .829 
.186 

,603 
.276 
- .928 

2 

1.813 

- .106 

- .151 

Zl > 

drp 

1.1204 

1.0686 

.0447 

.9216 

.0600 

1.0417 

1.1898 

1.0008 

.9168 



Ai 

Bi 

Cl 

Ai 

B . 

c . 

.946 

- .680 

.104 
1.042 
- .208 

.229 
- .110 
.917 

2 

.264 

.938 

1.036 



A , 

Bi 

Cl 

I 

II 

III 

.460 

.632 

.631 

.466 
- .864 
.194 

.461 
.262 
- .861 

2 

1.713 

- .203 

- .138 



Aj 

Bi 

Cl 

Ai 

B , 

C2 

1.000 

- .214 

- .171 

1.001 
- .169 

1.000 


Table S 


Fador Matrix FoAm => Vi 



At 

B, 

Cl 

1 

- .082 

.970 

.001 

2 

.026 

,066 

.038 

3 

.964 

- .068 

.016 

4 

- .021 

.600 

.723 

6 

.811 

.330 

- .002 

6 

.800 

- .031 

.387 

7 

- .071 

.737 

.610 

8 

.314 

.825 

.011 

0 

.462 

- ,017 

.766 

10 

- .043 

.636 

.621 

11 

.582 

.626 

.002 

12 

.642 

- .030 

.606 

13 

- .090 

.058 

.032 

14 

.088 

.001 

.919 

15 

.031 

- .037 

- .026 

16 

.688 

.246 

.366 

17 

.231 

.641 

.456 

18 

- ,070 

.046 

- .036 

19 

- .024 

.104 

.906 

20 

.945 

- .060 

.026 

Ch 

7.077 

7.348 

7.203 

2 

7.073 

7.342 

7.201 
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that if a trace moves toward the configuration in one diagram (as C in 
Figure 6) and away from the configuration in another diagram (os C in 
Figure 5), then the two corrections can be added in the same rotation with¬ 
out checking the numbers of the voiiables. 

Another example of the combination of two corrections is the /J-trace 
in Figures 4 and 6 . Here, again, one of the movement is toward tiic (son- 
figuration {Figures) and the other is away from tho configuration {Figurc.4). 
The two movements are written as follows: 


(27) 

Bi = l.OORi - .20C: 

and 


(281 

Bi = l.OORi + .lOA 


The two corrections are shown in the Sjs-matrix of Tabic 4. 

The steps in the computations of Table 4 are as follows; 

1) Compute the elements of Lo* by the relation 

AotSjj = Lm . 

2) Compute the diagonal elements dtp of the diagonal matrix ZJj. 

3) Compute the elements of the matrix Aos by tho relation 

Lo»Da = Aos. 

4) Compute the cosines c,, of Cs by the relation 

AggAos = Cg . 

5) Compute the elements of the next factor matrix by the relation 


FoAos = Va, 

6) Plot pail’s of columns of Yg on orthogonal cross-section paper and re¬ 
cord values of c,, on each diagram. 

The computation of Hu is optional os an alternative method of arriving 
at Yg. If it is desired to compute V g from Vt, then the computation i.s made 
by the formula 

Villa = Yg. 

If it is desired to compute Yg from the original factor matrix Fo, then wo use 
the formula 

FoAo, = Y,. 


n any event, the latter formula should be used for check on computations 
after five or six rotations have been made by the transformation H. 

The three plots for Yg of Table 5 are shown in Figures 7, 8, and 9 . These 
plots show that the reference axes are nearly in their final positions in tho 
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configuration. The A-plane is adjusted slightly in Figure 7. ^I'lie R-pIane 
is given two corrections, as shown in Figures 7 and 9. The C-plunc iieeils no 
further adjustment. These adjustments are .shown in the matrix iS',^ of 
Table 6, The computations of Table 6 proceed in the .Siinic way a.s for the 
previous rotations. The oblique factor matrix T ''4 is computed tus .shown in 
T<Me 7. 

When the factor matrix 1^4 of Table 7 has been computed, the three pairs 
of columns are plotted as shown in Figures 10, 11, and 12 . InKp(?ction of 



these three plots reveals the simple structure which became evident even 
after the first rotation. Since no further rotations are indicated in Figures 
lO-lS, they are accepted as the configuration for interpretation. This phase 
of factor analysis cannot be illustrated in the present problem, which is 
fictitious. The reference vectors are denoted Ap, as shown in the columns 
of the oblique factor matrix y 4 . The cosinas between tho.so reference vec¬ 
tors are shown in the matrix C 4 of Table 6. It is seen that these cosines are 
negative, from which we infer that the angles separating the reference 
vectors are obtuse. Hence the angular separations of the corresponding 
p^ary factors Tp can be expected to be acute. The interpretation is that 
the pnmary factors are positively correlated, 


Tabled 
Rolalian S 


Tabu? 

Factor Afoiri® FoAm = V4 


Matrix S» 



Bi 

cl 


At 

1.00 

.05 



lix 

.09 

1.00 


d|ir 

Cx 


- .06 

1.00 



i.og 

1.00 

1.00 




A{ 

Bl 

Cl 

inr 

I 

II 
III 

.402 

.654 

.648 

.466 
- .845 
.268 

.461 
.262 
- .861 



1.604 

- .112 

- .138 

D, 

drp 

.0680 

.0843 

1.0160 

1.0021 

1,0010 

.0000 

1.0002 

1.0001 

.9690 



Ai 

B, 

Cl 

A, 

1.016 

.050 


Bx 

.091 

.909 


Cx 


- .060 

1,000 


1.107 

.909 

1.000 




Aj 

Ac 

1 

.006 

.965 

.001 

2 

.032 

.009 

.038 

3 

.064 

- .010 

.016 

4 

.026 

.462 

,723 

6 

.864 

.370 

- ,002 

6 

.810 

- .009 

.387 

7 

- .003 

.707 

.510 

8 

.396 

.840 

,011 

0 

.468 

- .031 

.766 

10 

.016 

.602 

.621 

11 

.649 

.654 

.002 

12 

.640 

- .027 

,606 

13 

- .003 

.961 

.032 

14 

.090 

- .040 

.010 

15 

.043 

.012 

- .026 

16 

.721 

.268 

.366 

17 

.294 

.620 

.466 

18 

.016 

.943 

- .035 

19 

- .014 

.058 

.905 

20 

.966 

- .013 

.026 

Ch 

7.866 

7.335 

7.203 

X 

7.866 

7.336 

7.201 


LotDteiAgt 

At Cl 

I 

II 

m 

.500 .465 .461 

.663 - .844 . 252 

.658 .268 - .851 


1.721 - .111 - .138 


1 

AoiAo4"C4 

At Bi Ct 

Aa 

Off Ci 

1.000 

- .066 1.000 
- .188 - .226 1.000 
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The correlations between the primary factors Tp can be determined by 
the relation 

(29) Rpt = D(A'A)-iD , 

where the diagonal matrix D is so chosen that the diagonal elements of Rp^ 
are unity. The result is shown in Table 8. The procedures here described 

TahUa 
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are applicable for rotation of axes in any number of dimensions. The in¬ 
vestigator must make his own decision as to whether the axes are to be re¬ 
stricted by being orthogonal or are to be allow;ed to follow the configuration, 
as in the present example. He must also make his own decision as to whether 
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to restrict the factors to the positive manifold. It is probably be.*!! to impose 
none of these restrictions and to allow the reference vectors to be oblique 
if the configuration demands it or to allow each factor to be cither p<]i3itive or 
bipolar. 

There are several ways in which the results of a rotation can be antici¬ 
pated. These become apparent with practice. Several have been described 
here. It is useful to be able to predict whether a rotation will increase or 
decrease the cosine of the angle between two reference axes. Thi.s can be 
illustrated by Figure i. The cosine of the angle between the given vectors 
Aa and Afl, denoted A i and Si, is — .266. Tho negative sign means that they 
are separated by an obtuse angle. If the vectors should be orthogonal, then 
it is clear that Ai must move toward Bi, or else Si must move toward Ai. 
In this diagram. Si is moved toward Ai to the position Bg. Hence we can 
expect that the cosine will be increased toward zero unless the vector A i is 
also moved either by this diagram or by some other diagram. If the cosine 
of the angle between two reference vectors were positive, then they would 
have to separate in order to make them more nearly orthogonal. When we 
are dealing with cosines of large absolute value, thc.se rules are useful in 
avoiding a rotation by which two reference vectors might be made nearly 
collinear, in which case one of the dimenaion.s would be lost. Rfuicial eases 
sometimes appear in large studies in which these principles are adapted in 
different ways, but these become evident with practice. It is unfortunate 
that the rotational problem cannot be resolved in some routine which can be 
applied without judgment. The reason is that in dealing with actual fallible 
data we frequently meet with an incomplete simple structure which is over- 
determined for some hyperplanes and not for others. Furthermore, we deal 
with some positive or bipolar factors that are clear and overdetermined, 
some factors that ore only suggested by an almost indeterminate configura¬ 
tion in some dimensions, and with the unique variance and error variance, 
which obscure the less clearly defined hyperplanes. These conditions are de- 
te^ed by the test batteries that are assembled for investigation and 
which call for new factorial experiments. Factorial method as such does 
not pve a determinate solution for an iU-conceived factorial experiment. 

IS IS, in one sense, fortunate because it becomes a question of experimen¬ 
tal fact whether a hypothesis represented in the test battery is sustained in 
the factorial analysis. A pnncipal-axis solution is always available, and it is 
unique for any arbitraiy test batteiy; but it docs not, except in special cases, 

whether a psychological hypothesis about factorial 
composition is sustained or refuted. 

A single-plane method of rotation 

facteTZ^r^'^ computers, one of the most difficult in 

factor analysis. The reason is in the circumstance that most of the rotational 
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methods require some experience before the graphical representations can 
be handled effectively. It is our purpose in devising the present method to 
provide a procedure which can be handled by a clerk for most of the work. 
The method will be referred to as a single-plane method of rotation. The 
method seems to require little more experience than is necessary to estimate 
the slope of a line through the origin for a set of points. Questions of inde¬ 
pendence of rotation are minimized in importsjice, and the method seems 
to be convergent, so that a hyperplane can be located without a discourag¬ 
ing amount of labor. The computer need not think about the summation of 
vectors or about the distinction between a reference vector and its trace in 
the diagram. The method dora not postulate a positive manifold, so that 
it can be used as well for locating positive and bipolar factors. The method 
proceeds by locating one byperplane at a time, so that the investigator can 
begin the more interesting job of interpretation of each factor while the 
remaining ones are being computed. This method has only recently been 
devised, and it has been tried on several sets of experimental data with 
promising results. 

While it is not necessary for a clerk-computer to understand the theory 
of the method, it will be given first and then the routine which can be ex¬ 
plained to a novice in computing. 

In Figure fS let Q represent a trial unit reference vector whose direction 
cosines are denoted hmq- The fixed orthogonal reference axes are denoted 
by the subscript m, as in previous factorial work. We shall denote the given 
trial reference vector Q and the adjusted trial reference vector F. This will 
be done for each trial, so that the reference vector F that is obtained in one 
trial becomes the given trial vector Q for the next adjustment. This process 
continues for, perhaps, five or six adjustments, until the reference vector 
seems to be located. If there is no simple structure or if the particular hy¬ 
perplane is not defined by the configuration, that fact becomes evident. 

It is first assumed in Figure 13 that the trial vector Q is orthogonal to 
one of the orthogonal reference axes ikf as shown, but we shall see later that 
this restriction can be overcome. The projections of the test vectors J on 
the trial vector Q are computed and denoted Vjq (not shown on diagr ams ). 
We then have 

(30) Vjq — ajrnKnq , 

m 

where ay„ are the direction numbers of the test vector J with respect to the 
fixed orthogonal frame M. 

Since M is one of the unit vectors of the fixed orthogonal frame, we al¬ 
ready have the projections of the tests on this vector. They are the values 
o/m in a column of the given factor matrix F. If M in the figure represents 
the first centroid axis, then the projections (JMi) are given in the first 
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column of F. In the figure we have represented, by a set of points, the 
paired values from a column of F and the column of ti,-,. The objeot is to 
draw a line through the origin with a slope so chosen that a large number of 
the points will lie close to the line. This has been illustrated in Figure IS, 
and the slope Si is noted. It is simply the ordinate on the line TT for 
0= “f*l. 

Let L be a vector so defined that (1) it has unit projection on Q and (2) 
it is orthogonal to the line TT. The vector L can be expressed 

(31) L = Q~sM. 

Let Imq be the direction numbers of L. Then we have 


(32) Imq — Xmg — s, 

since the vector M is a unit vector on the co-ordinate axis M, The new 
vector A, will be collinear with L and of unit length. 

Let us now consider the ohlique case, which is illustrated in Figure 14- 
The trial vector Q has the projection on the vector M, as shown in the 
figure. The projection Xm, then is one of the direction cosines of Q, and M 
is in one of the fixed orthogonal axes. When the values of Vjq and a^m are 
plotted on orthogonal cross-section paper, the diagram will look like Fig¬ 
ure IS. The vector (—sM) is shown in Figure 14t where it is, of course, 
parallel to M. Here we write 

(33) U = Q-sM, 

where U satisfies only one of the requirements for L. The vector L is or¬ 
thogonal to TT, and so is the vector U. But the vector L is also defined as 
having unit projection on Q. The vector U can be extended by a stretch¬ 
ing factor k, so that it has unit projection on Q. Then we have 

(34) L = kU, 

as shown in Figure 14- In order to determine the stretching factor for TJ to 
give it unit projection on Q, we write 


(35) 

so that 

(36) 


UUQ) = 1, 

m )' 


where UQ is a scalar product. From (33) and (36) we have 
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or 

(38) 


* “ - 7MQ ’ 


and, since Q is a unit vector, we have 


(39) 


* “ 1 - sMQ • 


But the scalar product MQ is merely the direction cosine , for the axis M, 

Hence we write 


(40) 


k = 


1 


1 SXnig 


The direction number of Q for the axis M is as shown in tlie figure. 
Since the vector (— sM) is parallel to M, the direction number of the vector 
U for the axis M is 


The direction number of the vector L for the same axis i.s l„g, anti it i.s 

( 42 ) l„g = ku„g , 

so that the desired direction number can be written in the form 


(43) 


L 


1 — sXi 




whichis asimple computing formula. Here the X„,’.s are the direction tiosines 
of the given unit trial vector Q. The elope s is read directly from a graph. 
If there are r columns of the factor matrix F, then there are as many graphs 
to be plotted. Each one gives a slope value s„, which is set equal to zero if 
no rotation is indicated. 

When formula (43) has been evaluated for each of the orthogonal axes 
M, the new vector L is determined. It is then nonnalizetl and bccomos the 
new trial vector P. 

A numerical example 

example will be used to illustrate numerically this 
method of rotation. Table 9 shows a factor matrix P for twenty variables 
and three orthogonal factors. This table is the same as part of Table 3 of 
chapter m, except that it is here recorded to only two decimals. The prob¬ 
lem 18 to locate the reference axes Ap, which define a simple structure. 



rotation of axes 221 

The procedure starts with the selection of a test vector. In the present 
example, test 15 waa arbitrarily chosen as a starting vector. Its direction 
numbers are shown in row 16 of F in TahU 9. These three direction num¬ 
bers, are recorded in the first column of Table 10, trial 1. This vector 
is normalized, and it then becomes the first unit vector A* with direction 
cosines X„j, as shown in the second column. The computations for nor¬ 
malizing the given test vector are shown, in part, in Table 10. We then have 


Table 9 


Factor Matrix F Plane A 



I 

II 

III 

1 

Trials 

a 

3 

1 

.66 

-.74 

.14 

.13 

—!!■ 

.01 

2 

.72 

.18 

-.66 

.21 


.02 

3 

.66 

.54 

.50 

.99 

.94 

,96 

4 

.87 

-.21 

-.44 

.23 

- .04 

.03 

5 

.83 

.18 

.51 

.92 

.82 

.86 


.84 

.52 

.16 

.91 

.77 

.81 

7 

.86 

-.45 

-.27 

.19 

- .07 

.00 

8 

.85 

-.43 

.82 

.61 

.34 

.40 

9 

.86 

.42 

-.30 

.62 

.42 

.47 

10 

.88 

-.34 

-.36 

.22 

- .06 

.02 

11 

.89 

-.16 

.44 

.75 

.60 

.65 

12 

.88 

.48 

-.09 

.78 

.60 

.66 

13 

.67 

-.72 

.11 

.13 

- .06 

.00 

14 

.72 

.26 

-.62 

.27 

.04 

.09 

16 

.63 

.60 

.52 

.96 

.92 

.94 

16 

.94 

.26 

.16 

.84 

.67 

.72 

17 

.97 

-.24 

-.08 

.47 

.23 

.30 

18 

.62 

-.72 

.17 

.13 

- .03 

.02 

19 

.70 

.11 

-.66 

.17 

- .07 

- .02 

20 

.66 

.64 

.49 

.98 

.94 

.96 

2 

15.71 

-.02 

.06 

10.41 

6.93 

7.88 


Table 10 




Toat IS 

Q 











o/m 


s 

X—J 


1-A 

i 


Zaio .9173 

0-1.0411 

Trial 1 

I 

.03 

.66 

.26 

.41 

.16 

.84 

.49 

.44 

ZI>-1.2122 

a- .90827 


II 

.60 

.62 

-.18 

.70 

-.09 

1.09 

.64 

.68 

PQ -006 ^ = 

.9692 


III 

.62 

.64 

-.35 

.89 

-.19 

1.19 

,76 

. .68 

sin 

.28 

Trial 2 

I 


.44 

-.07 

.61 

-.03 

1.03 

.49 

.60 

ZI>- .QBSl 

a-1.0179 


II 

• • • 

.68 

.06 

.63 

.03 

.97 

.66 

.56 

PQ Ba QOB ^ B 

.9930 


III 


.68 

.06 

.63 

.03 

.97 

.65 

.66 

Bin 

.11 
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Sa»=.9173, as shown, and 1/V'sa*=c, which is tho multiplying factor by 
which 


Xmj t 

where c= 1.0441. 

The projections Vjg are then computed and recorded as shown under trial 1 
in Table 9. The column By, for the first trial is plotted against each of the 
three columns of the factor matrix F, and the three re-sulting diagrams are 
showii in the top row of Figure 15. On each diagram a line is drawn through 
the origin so that it goes through groups of points wherever possible. Large 
angular deviations of 30‘’-45® from the horizontal are not made unless the 
configura,tion of points clearly demands so large an angular deviation from 
the Jf-axis. The slope 8 „ of each line is noted, and it is recorded in the next 
column of Table 10, The slope of each line is read graphically. It is read 
directly from a vertical line through the point -fl on the base line. The 
rest of the calculations for trial 1 are self-explanatory, as shown in Table 10. 
The column is normalized and then becomes the column X„p. The cal¬ 
culations show 2)P= 1.2122, which gives the multiplying factor c=.90827. 
The column X„p shows the direction cosines of A„ which i.s the trial vector 
A, for the next trial. 

When the direction cosines Xmj of the next trial vector have been deter¬ 
mined, it is useful to compute the scalar product of the given vector Q and 
the new unit vector P. This is the cosine of the angular displacement 0, 
represented by the trial in question. The corresponding value of sine 0 is 
recorded as shown. For the first trial, sin 0 = .28. It will bo found that 
trials should be continued until sin 0 is about .10 or l&s.s. In the present 
example it is found that the second trial gives sin 0 = .ll, which is small 
enough that two adjustments are considered sufficient in this case. 

In the second section of Table 10 these direction cosines are copied in 
the column X#,,, as shown. The projections By, are computed and recorded 
m Table 9 in the column for trial 2. This column is plotted against the 
columns of the factor matrix F, and we then have the three diagrams in the 
bottom row of Figure 16. Here the groups of points are closer to the hori¬ 
zontal line m all diagrams, a fact which shows that the desired solution is 
being approached. A line through tho origin i.s drawn on each of these 
three diagi-ams which goes through the concentrations of points. The slopes 

Sm are lecoided in Table 10, and the rest of tho computations proceed as 
before. 

The value of sin 0 = .11, which is small enough so that further rotation 
IS not indicated. The projections By, of the test vectors on the reference vec- 
M computed and recorded in the lost column 

? f' column is, in fact, one column of the oblique factor 

matrix V. 




Figube is 
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In locating the next reference vector we start with one of the test vectors 
which lie in or near the plane already determined. Wo choose, therefore, 
one of the vectors that have small values in the last column of Table 9. We 
might start with any one of the vectors 1, 2, 4, 7,10, 13,14,18,19. These 
would not all lead to the same plane, but it does not matter in which order 
the planes are determined. The starting vector for determining the third 
plane is chosen from those test vectors which have small projections on 
both the first and the second reference vectors Ap. In this manner one avoids 
starting with a vector that leads to a plane that has already been deter¬ 
mined. If the configuration is indeterminate, this fact becomes evident 
when there is no clear indication of where to draw the lines on the graphs, 
or when the adjustments indicate large deviations that would carry the 
new trial vector into one of the reference vectors that have already been 
determined. 

It has been found that inexperienced student assistance can be used on 
these computations, most of which can bo arranged with check columns. 
The check suras have not been shown here for Table 10, It is a fortunate 
circumstance that an error in these calculations is self-correcting, in that 
the adjustment is made by the computations in the next trial. It is best to 
provide rather complete check columns so that each step is self-checking. 

The work of plotting the diagrams can be considerably reduced by not 
plotting the points for which o is smaller than v. These points have rarely 
any effect in determining the slope of the desired line through the origin, 
and they might as well be omitted in plotting the diagrams. 

When all the planes have been located by this method, either as planes 
of considerable variance or as residual planes, the columns of the oblique 
factor matrix 7 should be plotted in pairs. Small final adjustments can 
then be made, if necessary, by the methods described earlier in this chapter, 

The present method has been tried on several large factor studies, on 
small test batteries, and on fictitious examples, and it has so far been found 
to be rapidly convergent to the solution. One of its advantages seems to be 
that the computer need not worry about the independence of the several 
angular adjustments in each trial, because each of them affects only one of 
the direction cosines of the new trial vector. The difficulty caused by over- 
correction does not seem to be a problem with this method. 



CHAPTER XI 

THE METHOD OF EXTENDED VECTORS 

This method has proved to be effective in analyzing a factorial matrix of 
more than three dimensions, but it is applicable only in those cases in which 
a central reference vector can be found on which all the test vectors have 
positive projections. The method of tended vectors will be described, first, 
for a simple case of three dimensions, in which the new method gives the 
solution in one diagram if a simple-structure solution exists. The method 
will then be described with a five-dimensional fictitious example, which il¬ 
lustrates, perhaps better than the simpler example, just how the method is 
used in practice. 

The method of extended vectors for three dimensions 

In the previous chapter we described the method of rotation of axes by 
two-dimensional sections, which are represented on diagrams. Each dia¬ 
gram represented the plane determined by two of the reference vectors, and 
it was plotted from pairs of columns of the factor matrix F. In the method 
of extended vectors these sections represent three dimensions. The prin¬ 
ciple of the method will be explained briefly before the numerical example 
is given. 

Let Figure 1 represent a configuration of test vectors with origin at 0. 
Let the axis I represent the first centroid axis, the major principal axis, or 
any other axis that is central in the configuration and on which all the test 
vectors have positive projections. Let the arc CC represent a unit sphere 
with center at 0, and let the reference vector J be of unit length. Consider, 
next, the plane PP, which is tangent to the unit sphere and orthogonal to 
the central axis I. In a configuration of r dimensions this plane becomes an 
(r — l)-dimensional hyperplane. Let each test vector be extended so that 
its terminus is in the plane PP. All the test vectors will then have unit 
projection on the axis I. Each test vector is extended by the multiplier 


so that its projection on the I-axis is unity. This has been done in Table 1. 
The extended factor loadings were obtained from Table 1 of the previous 
chapter. The multiplier D, for test j is applied to all the factor loadings o,„ 
of that test to determine the corresponding extended factor loadings Ajn of 
Table 1. 
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In Figure 1 let OAB represent one of the co-ordinate planes containing a 
number of the test vectors. When these have been extended, their termini 
also lie in the tangent plane PP. Since the intersection of two planes is a 
straight line, it is clear that the termini of the test vectors in the co-ordinate 
plane OAB will lie in a straight line in the plane PP and that this linear ar¬ 
rangement of test vector termini should be evident if a plot is made of col¬ 
umns II and III in the extended factor matrix. 

The normal A defines the co-ordinate plane OAB of a simple structure. 


/> 



The direction cosines of A may be denoted Xi, Xa, X j, and, hence, the equation 
of the plane OAB may be written in normal form as 

(2) Xi®! + Xjs;* + Xjajj = 0 , 

where Xi is the projection of any point (a:i, !Ea, ars) of the plane on the /-axis. 
Since the plane PP is tangent to the unit sphere and orthogonal to the 
/-axis, all points in that plane have unit projection on that axis, so that 
®i=L The equation of the line of intersection AB of the two planes is, 
therefore, 

(3) Xi -f- XaiCj -|- XjXs = 0, 

when referred to orthogonal axes in the plane PP which are parallel to 
II and III. 
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When E plot is made of columns II and III of Table 1, we have Figure B, 
where the points are clearly arranged in three intersecting lines. The equa¬ 
tions of these lines were determined graphically, and they are as follows: 

Trace of Z-plane .58 — 12 + .32a:s = 0 , 

Trace of 7-plane .55 .30a:2 — a:* = 0 , 

Trace of 7-plane .71 + .83a!2 -f = 0 . 


These equations correspond to equation (3), and it will be seen that the con¬ 
stant term of this equation is the coefficient of ajj in equation (2). 

Table 1 

Extended Fador Mainx £0 


Test 

O4 

I 

II 

III 

1 

1.6176 


- 1.117 


2 

1.3703 


.248 

Hlfl 

3 

1.6038 



.762 

4 



- .241 


5 

1.1990 

1.000 

.218 


6 

1.1062 

1.000 

.621 

.182 

7 

1.1682 

1.000 

- .628 

-.314 

8 

1.1792 

1.000 

- .602 

.377 

9 

1.1614 

1.000 

.483 

-.347 

10 

1.1364 

1.000 

- .388 


11 

1.1249 

1.000 

- .166 


12 

1.1429 

1.000 

.664 


13 

1.4092 

1.000 

- 1.087 

.163 

14 

1.3047 

1.000 

.343 

-.863 

15 

1.6773 

1.000 

.792 

.823 

16 

1.0684 

1.000 

.275 

.176 

17 

1.0352 

1.000 

- .247 

-.086 

18 

1.6000 

1.000 

- 1.152 

.266 

10 

1.4245 

1.000 

.160 

-.926 

20 

1.6060 

1.000 

.807 

.736 


The plot shown in Figure 2 enables us to determine the direction num¬ 
bers of a normal to each co-ordinate plane. When these are normalized, we 
have the direction cosines of each reference axis Ap. 

The successive steps in the numerical work will now be described. On 
Figure 2 the three traces are denoted the X-, 7-, and 7-planes, as shown. 
The coefficients are recorded in the S-matrix of Table 2. In this case the 
matrices S and L are identical. The columns of L are normalized as in the 
previous work, and the multipliers drf are determined. Applying these mul¬ 
tipliers to the columns of L, we get the matrix A, the columns of which show 
the direction cosines of the three reference vectors Ap. It will be seen that 
this matrix A is the same as Ad 4 of Table 6 of chapter x, which was obtained 
after three rotations. The slight discrepancies are due to the fact that the 
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two solutions were obtained graphically. The columns X, Y, and Z of a in 
Table S correspond to the columns B, C, and A, respectively, in the ma¬ 
trix Aoi of Table 6 of chapter x. The order in which the reference vectors 
are listed in the columns of A, or of the factor matrix, is, of couise, imma¬ 
terial. 

The oblique factor matrix V of Table 2 was obtained directly from the 
given factor matrix Fq of Table 1 in chapter x by the transformation A in 
Table 2. The matrix A'A = C shows the cosines of the angles between the 
reference vectors, and the matrix T shows the direction cosines of the pri¬ 
mary vectors Tp. Their angular separations are shown in the matrix TT', 


sr 



This is the matrix IZ,,,, which gives the correlations between the primary 
factors Tp, These correlations are the same as the correlations shown in 
Table 5 of chapter x. The slight discrepancies are duo to graphical methods. 
For example, the correlation -1-.106 in one table corresponds to the corre¬ 
lation -I-.112 in the other table. 

We have shown here an application of the method of extended vectors to 
a problem in three dimensions. Since this method consists in taking three- 
dimensional sections of an r-dimensional configuration and since r=3 in 
this case, the whole configuration os to its co-ordinate planes is defined here 
in one diagram, Figure 2. When r exceeds 3, it is necessary to make more 
plots, but not so many as in the method of plotting two-dimensional sec¬ 
tions described in the previous chapter. 
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The advantage of the method of extended vectors is that traces can be 
drawn anywhere on the plot, since they need not be radial, as in the two- 
dimensional method. A streak of points anywhere on the diagram can be 
brought into a co-ordinate plane. The number of rotations is usually much 
smaller than with the two-dimensional method, but the extended form of 
the factor matrix must first be computed. The method of extended vectors 
is not applicable when the configuration is of such a character that no cen¬ 
tral vector exists on which all the test vectors have appreciable positive 
projections. It is sometimes possible to use the method when all but a few 
of the test vectors have positive projections on some central axis, but special 


Table S 


Matrix S—L 

X' V Z' 

I 

II 

t ». III 

Vip 

dr^ 

.68 .55 .71 

- 1.00 .30 .83 

.32 - 1.00 1.00 

1.4388 1.3925 2.1030 

l.ieOS 1.1800 1.4800 

.8337 .8475 .6763 


Matrix A 

X Y Z 

I 

11 

III 

.483 .466 .470 

- .834 .254 .660 

.267 - .847 .676 


Matrix 

X Y z 

X 

Y 

CpQ Z 

1.000 

- .213 .909 

- .066 - .206 .999 


Factor MaMat V 



X 

Y 

Z 

1 

.060 

.003 

-.003 

2 

.026 

.939 

.006 

3 

.007 

.023 

.057 

4 

.476 

.727 

.000 

5 

.387 

.005 

.844 

6 

.012 

.303 

.794 

7 

.719 

.612 

-.026 

8 

.850 

.016 

.384 

0 

-.011 

.760 

.444 

10 

.615 

.623 

-.008 

11 

.668 

.008 

.638 

12 

-.007 

.610 

.628 

13 

.066 

.034 

-.013 

14 

-.024 

.921 

.063 

15 

.028 

-.019 

.037 

16 

.282 

.362 

.704 

17 

.644 

.460 

.273 

18 

.947 

-.032 

.008 

19 

.072 

.906 

-.040 

20 

.004 

.032 

.948 


Matrix T' 


X 

Y 

z 


ij 

.661 

.718 

.664 


II 

- .736 

.199 

.646 


III 

.144 

- .671 

.624 


Matrix TT 

X Y Z 

X 

1.000 

ftpg Y 

.229 1.000 

z 

.106 .224 1.000 
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adjuatmenta are then necessary to write the final rotated factor matrix for 
the whole battery. 

The method of extended vectors for n dimensions 

The principle that has been described for a three-dimensional example 
will now be applied to a fictitious five-dimensional example. We start this 
problem with a simple structure, shown in Table S. Here we have twenty- 
five variables, and arbitrai-y factor loadings have been recorded in this fac¬ 
tor matrix for the five columns shown. This matrix may be denoted 

Tables 


A Ficlilioua Simple Configuration 



m 


11 

B 

B 


1 

.0 

.3 

.0 

.0 

.8 

.73 

2 

.0 

.9 

.0 

.0 


.81 

3 

.6 

.5 

.0 

.5 

Hfifl 

.76 

4 

.5 

.7 

.0 

.0 

.0 

.74 

5 

.0 

.3 

.3 

.0 

.7 

.67 

6 


.4 

.6 

.4 

.0 

.68 

7 

.0 

.0 

.8 

.0 

.0 

.04 

8 

.0 

.6 

.7 

.0 

.0 

.74 

0 


.0 

.6 

.6 

.0 

.72 

10 

.0 

.0 

.4 

.0 

.5 

.77 

11 


.0 

.6 

.4 

.0 

.77 

12 

,7 

.3 

.3 

.0 

.0 

.07 

13 

.0 

.0 

.0 

.0 

.9 

.81 

14 

.0 

.8 

.0 

.4 

.0 

.80 

16 

.0 

.0 

.6 

.0 

.3 

.70 

16 

.6 

.0 

.6 

.0 

.0 

.72 

17 

.0 

.0 

.7 

.0 

.5 

.74 

18 

.4 

.0 

.0 

.0 

.7 

. 6 .') 

10 

.8 

.0 

.0 

.0 

.0 

.04 

20 

.0 

.0 

.0 

.6 

.6 

.72 

21 

.0 

.0 

.0 

.8 

.0 

.04 

22 

.3 

.0 

.0 

.4 

.7 

.74 

23 

.0 

.6 

.0 

.6 

.6 

.75 

24 

.7 

.3 

.0 

.0 

.3 

.07 

25 

.3 

.0 

.0 

.8 

.0 

.73 


The communalities are also recorded. In Table 4- we have an arbitrary or¬ 
thogonal matrix A,o, which transforms!*’,into thefactonnatrix/'’oof TableS. 
We then have the relation 

(4) P ,A,o = Ft), 

We start the problem with this matrix as given, and our problem is to ana¬ 
lyze it in such a. way as to rediscover the simple structure of Table S, which 
will be regarded as unknown during the computations. 

The first step is to extend the test vectors of Table B. The last column of 
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tbsit tEble shows the reciprocal of the first-factor loading by equation (1). 
Multiplying each row of Fo by the corresponding value D,, we have 


(5) 


DtF g = Ea ; 


and we then have the extended factor matrix Eg of Table 6, in which each 
entry in the first column is unity. 

There are four columns that can be plotted to show the configuration, 
and these give six diagrams. Only three of these diagrams are shown in 


Table 4 


An Arbitrary Orthogonal Transformation Amo 



1 

n 

ni 

IV 

V 

Pi 

.447 

-.148 

-.092 

-.832 

-.282 

P, 

.409 

.543 

.595 

-.084 

.420 

P> 

.447 

-.431 

-.376 

.128 

.878 

P* 

.447 

.654 

-.654 

.307 

-.307 

Ps 

.484 

-.438 

.438 

.438 

-.438 


Tables 


A Centroid M<drix Fo of the Ficiitiove Test BaUery 



I 

11 

III 

IV 

V 

£>• 

1 

.510 

-.188 

.629 

.325 

-.224 

1.9608 

2 

.368 

.489 

.536 

-.076 

.378 

2.7174 

3 

.652 

.474 

-.026 

-.304 

-.084 

1.5337 

4 

.510 

.306 

.370 

-.475 

.153 

1.9608 

6 

.596 

-.273 

.373 

.820 

.023 

1.6779 

6 

.611 

.180 

-.209 

.106 

.462 

1.6367 

7 

.358 

-.346 

-.300 

.102 

.642 

2.7933 

8 

.517 

-.030 

.035 

.048 

.686 

1.9342 

9 

.636 

.074 

-.567 

.261 

.223 

1.8667 

10 

.689 

-.059 

-.263 

.464 

-.132 

1.4614 

11 

.670 

-.083 

-.464 

-.312 

.047 

1.4926 

12 

.570 

-.070 

.002 

-.669 

.132 

1.7644 

13 

.436 

-.394 

.394 

.394 

-.394 

2.2936 

14 

.606 

.666 

.254 

.066 

.213 

1.9763 

15 

.637 

-.436 

-.111 

-.304 

.038 

1.5699 

16 

.536 

-.347 

-.280 

-.422 

.238 

1.8657 

17 

.555 

-.621 

-.044 

.309 

.266 

1.8018 

18 

.518 

-.306 

.270 

-.026 

-.419 

1.9305 

19 

.358 

-.118 

-.074 

-.666 

-.226 

2.7933 

20 

.659 

.070 

-.070 

.447 

-.447 

1.7889 

21 

.358 

.443 

-.443 

.246 

-.246 

2.7933 

22 

.652 

-.129 

.067 

.180 

-.514 

1.6337 

23 

.670 

.330 

.240 

.330 

-.162 

1.4926 

24 

.581 

-.072 

.246 

-.476 

-.203 

1.7212 

26 

.492 

.399 

-.471 

-.004 

-.330 

2.0325 
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Figures 3, 4, 5, and 6, since these are the only ones that wore used for de¬ 
termining the initial locations of the reference vectors. 

The successive computations are shown in the formulae for each part of 
Table 8 and subsequent tables. It will be seen that some of the matrices 
have an added column for the first centroid factor, which was u.sed in writing 
the extended factor matrix. The new notation is for the matrix M, which is 
identical with A except for the added column for the central axis {!)} At 
any stage in the rotations, the matrix A can be written by merely ojnitting 


Tobies 

Extended EatUerial Matrix Eo 


I 



I 

II 

III 

IV 

v 

1 

1.000 

- .309 

1.037 

.637 

- .438 

2 

1.000 

1.329 

1.457 

- .207 

1.027 

3 

1.000 

.727 

- .040 

- .400 

- .120 

4 

1.000 

.600 

.725 

- .031 

.300 

5 

1.000 

- .468 

.026 

.537 

.030 

6 

1.000 

.296 

- .842 

.272 

.740 

7 

1.000 

- .904 

- .838 

.285 

1.514 

8 

1.000 

- .058 

.008 

.003 

1.326 

9 

1.000 

.138 

- 1.030 

.487 

.416 


1.000 

- .080 

- .382 

.650 

- .192 

11 

1.000 

- .124 

- .603 

- .460 

.070 

12 

1.000 

- .123 

.004 

- .098 

,232 

13 

1.000 

-■ .004 

.904 

.904 

- ,( K )4 

14 

1.000 

1 . 2 Q 0 

.602 

.111 

.421 

16 

1.000 

- .684 

- .174 

- .477 

.060 

16 

1.000 

- .647 

- .622 

- .787 

.444 

17 

1,000 

- .939 

- .070 

.557 

.461 

18 

1.000 

- .707 

.621 

- .050 

- .800 

19 

1.000 

- .330 

- .207 

- 1.860 

- .631 

20 

1.000 

■.125 

- .126 

.800 

“ .800 

21 

1.000 

1.237 

- 1.237 

.687 

- .687 

22 

1.000 

- .108 

.087 

.270 

- .788 

23 

1.000 

.403 

.368 

.403 

- ,242 

24 

1.000 

- .124 

.423 

- .810 

- .340 

26 

1.000 

.811 

- .067 

- .008 

- .671 


the first column from the matrix ilf. In the methcjd of extended vector-s the 
matrices S, L, H, and C have the additional column for (7). 

The new "B-plane 

Figure 3 shows the plot for columns H and IV of Tahh 0, A unit vector 
is indicated by an arrowhead on the //-axis, and anotlier unit vector is 
shown similarly on the 7F-axis. These are the given unit reference vectors 
(77) and (77). A line has been drawn through a streak of p<imts to repre¬ 
sent the trace of one of the planes. It is not necessary that the traces should 

^ The notation "(/)” will be used to denote a unit rector in the axis /. and similarly for 
the other orthogonal reference axes. 
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bound the configviration as in the present case. A normal is drawn through 
the origin, as shown by tlie dotted line. The direction of the normal is 
shown by the arrowhead. The direction of the normal is so chosen that the 
projections of most of the points, which represent test vector termini, will 
be positive. Since this normal is closer to the//-axis than to the other axis, 
we denote the trace the B-plane, and the normal is denoted Bi The sub- 



Fietiui 3 

script of Rj represents a new location, and the prime indicates that the new 
vector is a long vector that has not yet been normalized. 

Since the new vector is closer to {11) than to (IV), we shall describe it as 
equal to the unit vector {II) plus corrections in the directions of {IV) and 
(7). The vector (77) is then a base vector for Bj. In Figure 3 we draw the 
normal J5j so that its terminus is directly above the terminus of the unit 
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vector {II). The new long reference vector can be described by the 
vector equation 

(6) B', = {II) -b d{IV) -H i{I), 

which requires only two numerical values to be found from the graph, 
namely, d and i. When found, these values arc rccord(!(l in the /ij column 
O'f the matrix Sn in Table 8. 


m 



The value of the coefficient d is read directly from the graph. It is mere¬ 
ly the vertical distance from the terminus of {II) to the terminus of iij on 
Figure 3, namely, 0.23. These diagrams are ordinarily drawn on cross-sec¬ 
tion paper, where finer gradations are available than on the figures of this 
chapter. 

The absolute value of the coefficient i is read directly as the intercept of 
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the trace on the same axis as the base vector {II). This intei-eept is 0.79. 
The coefficient i is taken as positive if the origin and the new vector are on 
the same side of the trace, as in this case. The coefficient i is taJten negative 
if the origin and the new vector are on opposite sides of the trace. 



Fionas 5 

Having read the two numerical values d and i on the graph, wo can write 
the vector eciuation (6) in numerical form, namely, 

(7) = 1.00(77) + .23(7r) + .79(7) , 

and these coefficients are written in the column of the matrix Soi in 
Table 8. 

The new C-plane 

In Figure 4 we have the plot for columns II and III of the extended factor 
matrix Ea of Table 6. The two unit vectors (77) and (777) are shown by ar- 
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rowheads in the II- and Ill-axes, respeftivcly. A trace has l)een drawn 
through or near eight points. The normal i.H nearer III tlian II, and lieiico 
the trace is labeled the C-plane. 

Since the unit vector (III) is the base vector for this diagram, we draw 



the normal CJ so that its terminus has unit projutition on (III), as in the 
previous figure. The new vector Ci is described by the vector cfiualion 

(8) Ci = (III) + b(II) -h i(I). 

The coefficient b is read directly from Figure 4 as the distance between the 
termini of (III) and C'^, namely, — .62. The intercept of the trace on the 
III~^'^ has the absolute value .35. It is token positive, since the origin 
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and the vector CJ are on the same aide of the trace. Hence we have the vec¬ 
tor in numerical form, 

(9) Ci = 1.00(71/) - .52(17) + .35(7), 

and the coefficients are recorded in the column of Su in Table 8. 

The new "Enplane 

In Figure 5 we have the plot for columns II and V of Tdble 8. Here a 
trace has been drawn through, or near, twelve points. The normal is drawn 
through the origin to so that it has imit projection on (F), which is taken 
as a unit base vector. The vector equation of E'^ then is 

(10) E', = (7) + 6(77) + i{I), 

where 6 and i are to be determined from the graph. The value of 6 is read 
as — .70. The absolute value of the intercept of the trace on the F-axis 
is .36. It is taken as positive because the vector E'^ and the origin are on 
the same side of the trace. Hence we have the vector equation in numerical 
form, 

(11) Ei = 1.00(F) - .70(77) + .36 , 

the coefficients of which are recorded in column E'^ of Sn in Table 8. 

The new A- and D-planea 

Figure 6 shows an example of a graph in which two new planes are de¬ 
termined. In locating two planes on the same diagram, one avoids drawing 
traces that are parallel, for reasons to be discussed. One trace is drawn 
through seven points. Such a configuration is useful in locating the simple 
structure not only because a number of points lie in a straight line but also 
because they extend over some length on the diagram. In the case of two 
alternative traces with the same number of points, one prefers the one that 
has more length on the diagram. 

Another trace is drawn through about thirteen points, and a noirmal is 
drawn through the origin. Both normals are drawn in the direction of the 
configuration, so that most of the test vectors will have positive projections. 
Since the normal to this trace is nearly parallel to (7F), this trace is denoted 
the D-plane. The first trace might have been denoted the E-plane, but 
such a plane has already been chosen, so this one is denoted the A-plane, 
thus locating five new planes, A to E, inclusive. 

The normal to the iS-trace is drawn through the origin and extended so 
that it has unit projection on the base vector (7F), The vector equation for 
the normal then is 


(12) 


D',= -(7F) + e(F) + i(7), 
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where e and i are to be read graphically. The value of e is -.20, and the 
absolute value of i is .54. This is taken positive because the normal D'^ and 
the origin are on the same side of the trace. We then have the vector equa¬ 
tion in numerical form, 

(13) = -1.00(/F) - .2{)(7) + ..54 , 

the coefficients of which are recorded in (columns 1)'^ of tS'oi in Table 8. 

The normal to the A-trace is drawn through the origin to the point Aj 
with unit projection on {IV), which is arbitrarily chosen a.s a base vector. 
The vector equation for Aj can be written 

(14) Ai = {IV) + e{V) + i{I ). 

The numerical value of e is —.97, and the ab.soluto value of i l.s 1.20, 
which is taken positive because Aj and the origin are on the same side of 
the trace. We then have the vector equation in numerical form, 

(16) A'i = 1.00(77) - .97(7) + 1.20(7), 

the coefficients of which are recorded in the Aj column in iS’oi c»f 'Table 8, 

It so happened that all the increments i for the vector (7) were positive 
in this set of four diagrams. In each of the subs(.u|ucnt rotations there will 
be cases of negative increments for (7), as may be seen from the diagrams 
and from the firat row of the matrix S in Tables !), 10, and 11. 

Independence of planes 

When the traces have been drawn for the planes, it i.s (Itwirable to ascer¬ 
tain, before proceeding with the computations, whotlier the planes arc 
linearly independent. It sometimes happens that the sumo plane i.s repre¬ 
sented by streaks of points on several diagrams. If these traj.’cs were identi¬ 
fied as different planes, one would discover in the subsequent computation 
that the two corresponding normals had an angular separati(ni with a co¬ 
sine of, say, .80 or .90. The result might be that one of the {.■ommon-factor 
dimensions had been lost. In order to avoid the annoyance of the tiompula- 
tional adjjjiBtraents that would then be necessary, it is wt^ll to inspect tlio 
planes for linear independence. This is not nccetisary in tli(( later rotations 
where the planes are easily identified from one rotal ion to tins next, but it is 
advisable to malco an inspectional chock on linear indepeiuhmcat at tli(i start 
of a factorial analysis. The check will be described here only for the initial 
location of the reference vectors. 

In Table 7 we have five columns, one for each of the five normals that 
have been chosen. In column A there is recorded a plus sign for each test 
variable that has a large positive projection on the normal A!,, a zero for 
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each test that has nearly vanishing projection on that normal, and a blank 
space for those tests whose projections are neither conspicuously high nor 
vanishingly small. In some of the columns there are recorded minus signs 
for those tests which have conspicuously strong negative projections. 

For every pair of columns, there must be differentiation as to the plus 
signs, the minus signs, and the zeros. In the present case we have chosen 
the five normals so that they are linearly independent. If we had chosen 
two normals with small angular separation, they would have had the same 

TdbUr 
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0 

26 
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" 


tests with high positive projections, the same tests with strong negative 
saturation, and the same tests with small projections. That would indicate 
the fact of linear dependence, and one of the normals could then be discard¬ 
ed in favor of a new one which should be linearly independent of the other 
four normals. If such a situation arises, it is a useful procedure to select the 
tests which have no plus signs or minus signs and to find a trace on whose 
normal the missing tests would have significant projection, either positive 
or negative. That would, in general, insure the recovery of all the dimen¬ 
sions of the common-factor space. One way to avoid the loss of a dimension 
is to designate a new reference vector by the fixed orthogonal axis to which 
it is the closest, but this procedure is not always feasible. 



Computations from Figures S, 4i S, 8 
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Alternative method of writing the S-matrix 

A variant of the method that has been described for Figures S, 4, S, and 6 
may be preferred by some students. One writes the equation of the trace in 
the form 

(16) Oj Xt + OaKa + d = 0 , 

which might represent the A-plane determined from a diagram of two col¬ 
umns II and HI. If most of the points of the configuration are on the 
same side of the trace as the origin, then the constant term in (16) should be 
positive. If the constant term in (16) is negative, the signs of all the terms 
are reversed. If most of the points in the configuration are on the opposite 
side of the trace from the origin, then the constant term must he negative. 
The three coefficients are then recorded in the appropriate column of the 
(S-matrix. Other variations of these procedures can be easily devised to 
suit individual preferences. 

Computations for Table 8 

When the matrix /Soi has been written by inspection of the graphs, the 
remaining computations of Table 8 follow the formulae given and in the 
order given in the table. In the initial location of the reference vectors the 
matrices iSqi and Loi are identical because the matrix 8 describes the new 
reference vectors in terms of the fixed orthogonal frame. From the matrix 
Loi we obtain the diagonal entries of Di as shown. Then we determine Hn, 
which is in this case identical with Moi. For subsequent rotations they will 
be different. The matrix Ci shows the cosines of the angular separations be¬ 
tween the reference vectors. These cosines are recorded on the diagrams 
for the next rotation, as shown in all subsequent figures. The new oblique 
factorial matrix Ei is computed either from Hn or from iWoi. In practice 
it is not necessary to write the column I in the extended factor matrices. 
The column is here given explicitly to show the complete result of the in¬ 
dicated matrix multiplications. The factor matrix Ei is used for plotting 
the next set of diagrams. 

The first rotation 

The ten pairs of columns of the factor matrix Ei are plotted on as many 
diagrams, and these are inspected to select the first rotation of the reference 
axes. Only three of the ten diagrams were used, and they are represented 
in Figures 7, 8, and 9. Figure 7 shows a type of plot that occurs rather fre¬ 
quently in factor analysis, which indicates an almost rigid rotation of two 
axes, Ai and (7i, through a large angle. In all these diagrams we record in 
the corner of the diagram the cosine of the angle separating the two ref¬ 
erence axes that are represented by the plot. When these cosines deviate 
markedly from zero, they are used in making a choice of rotation. From 
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this diagram we obtain the entries in (■oluinns and CJ of matrix Hu 
in Table 9. We have here an example of a negative (•orroction for tlie vec¬ 
tor (Z) in the column Ci The negative sign of this cfjrrertion is determined 
by the fact that the vector Cj and the origin are on opposite sides of the 
trace for the new C-plane. The procedure is the same as that bescribed for 
the previous diagra mB and tor Table 8. 



PlOBllB 7 


In Figure 8 we have the plot for li and D, on wliir-h lias boon drawn the 
trace for the new Z)-plane, with a slight adjustment. In Figure 9 we have 
t e plot for columns C and E, which indicates a rather compelling adjust¬ 
ment m the i?-plane. The cosine of the angular separation between and 
1 IS +.326. The positive sign of this cosine indicates that the two refer- 
ence vectors should separate if they are to be orthogonal or nearly orthogo¬ 
nal. In the present case the vector Ei moves away from the vector Ci to 
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the new position E^. The positive sign of the cosine and the appearance of 
the diagram show that the two vectors E and C will be orthogonal, or 
nearly so. In this rotation no adjustment is made in the B-plane. This is 
represented by the entry of unity in the B column of S 12 in Table 9. Hence 
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The second rotation 

Pairs of columns of the oblique extended factor matrix E* are plotted on 
ten diagrams, three of which were used to select the adjustments for the sec¬ 
ond rotation of the reference axes. These three plots are shown in Fig~ 
ures 10,11, and 12. 

Figure 10 gives two clear traces of the planes. On the vertical axis we 
see a large collection of points near the origin and no points elsewhere on 




Tabu 9 

from Figures 7, 8,9 
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the vertical axis. Two points, namely, 2 and 4, are in a radial line, and these 
are combined with the points near the origin for the traee of the new A- 
plane. The corresponding entries are made in the matrix of TcMe 10. 
The other trace on this diagram is also clearly indicated. There are no 
points on the horizontal axis of this diagram, except those which are at the 
origin, and consequently there is no configuration to hold the reference 


£ 



normal B in its given position. On the other hand, there are seven points 
in the first quadrant which are radial, and these are used in selecting a newly 
adjusted position for the B-plane. In each case the plane is identified by 
adjustments that are less than 45". The corresponding entries are made in 
the matrix ^>23 of Table 10. 

In Figure 11 we have a small adjustment in the D-plane as shown, and 
in Figure 18 there is indicated a small adjustment in the E-plane. These 





Table 10 

from Figures 10, 11, 12 
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diagrEms indicate very clearly that the configuration is closing in toward a 
simple structure. No compelling adjustment was found for the C-plane in 
this set of diagrams, and consequently there is only one entry of unity in 
the C-column of matrix Sn, according to which the new reference vector 
Ci is collinear with the given reference vector Cj. 


B 



Fianiui 10 


Inspection of the angles in this set of diagrams shows one large cosine, 
namely, AB, which is +.580. If the simple structure is orthogonal, or near¬ 
ly so, we should expect the two reference axes, A and B, to separate. In¬ 
spection of Figure 10 shows that, when we follow the configuration, the two 
new reference axes, A't and Bj, do separate, as shown by their new locations 
in the dotted lines. Their given positions are plotted as orthogonal in the 
figure, but their new separation is an obtuse angle. Fiuiher rotations should 
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give only small angular adjustments. The computations for thi.s rotation are 
indicated in Table 10, and the result is the extended factor matrix I?,, which 
is used for plotting the next set of diagrams. 

The third rotation 

The third rotation is determined by the traces that are drawn on Figures 
13-17, inclusive. The procedure is the same as for the rotuf ion.s sclncted on 


O 





/? 



' 





• 

? . 

1 

# 

•« ■■ 

♦wi — j 






• 


_0 P/ons 

9 

• 


, 

W'- 






rt 




















C0Sm~.O79 









Fhiubb U 


the previous diagrams, except for the combiniithjn of two r<jtation.s for the 
.B-plane. Figure 17 indicates a small adjustment in the /S-plane as shown, 
and A'pure l^. indicates a smaller adjustment of the same plane. // the cot~ 
redions are limited to small angular adjustments of a plane ioith traces through 
the origin, then two or more adjustments can be combined in the same rotation. 
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Figures 14 and 17 show the combination of two adjustments of the ^-plane 
in the same rotation, In Figure 17 the long vectors that are brought into 
the plane are W, 21, and 25, and these are near the origin of Figure 14- 
Hence a small adjustment in the S-plane on Figure 14 does not affect the 
factor loadings on E of these three tests. On the other hand, a small adjust- 



Fiourb 12 


ment of the .E-plane in Figure 14 involves test 2, which is near the origin 
in Figure 17. The two adjustments are therefore said to be independent. If 
testa 20, 21, and 25 had high projections on both A and B, then the two 
adjustments from these diagrams could not be combined because they 
would result in an overcorrection. In making the adjustments from Fig~ 
ures 14 and 17, it would not even be necessary to identify the numbers of 
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the-test vectors in both figures becEUse of E principle thnt is often useful: 
When one adjustment moves a configuration slightly out of a plane while the 
other adjustment moves it slightly into the plane, then the two adjustments can 
he combined with assurance that they are independent without identifying the 
test vectors in both diagrams. In the present example the adjustment shovm 
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in Figure 17 tends to move the plane down from the configuration, whereas 
the adjustment shown in Figure Ij. tends to move the plane up into the con¬ 
figuration. Hence the two adjustments can be combined with assurance 
that they are independent. The adjustment in Figure Ij. will produce a 
small negative factor loading for test I4, whereas the adjustment in Fig¬ 
ure 17 will produce a small positive factor loading for test 14. The result 
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should be a negligible factor loading for this test when the two adjustments 
are combined. 

The adjustments selected in Fiqjivbs 13 ~ 1 Tj inclusive; are recorded in the 
matrix 1 S 34 of Table 11. The remaining computations for this table proceed 
according to the formulae shown and as described for previous rotations. 
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The result is shown in the oblique extended factor matrix Ei of Table 11. 
The matrix Ct gives the cosines of the angles between the reference vectors, 
as well as the projections of these vectors on the unit centroid vector (/). 
It is seen from this table that the reference vectors are nearly orthogonal. 
In dealing with an oblique factor problem it should be recalled that the 
matrix C gives the cosines of the angles between the reference vectors. The 






TiMell 

Ctmvpvlaiicnt from Figures IS, 14, IB, IS, 17 



014 

015 

023 

024 

515 

986 

238 

362 

117 

582 

714 

486 

013 

009 

755 

080 

268 

019 

080 

004 

005 

Oil 

005 

037 

027 


fe) 

1 

fc) 

II 1 1 1 1 1 1 




M4ffiQio^c4^cQTjctonHtO'4moa Mcoi^oonmc&o 
So®o6§HooHoe«2gMC2wg;jM-:j§2P2C2 

O O to P O O O O O O P O O a 01 O N O O ^ O ^ o 


1 

g**t 

Qra 

oo 


H rl ^ 

II 1 1 1 1 1 



1 


Ifi 00 i! 0» O « cq 0) N N JH M 35 « s ® ? :t rJ 9® ® SJ ffi 2 i 

N C4 <N M N M 7IH >-l O U IN (0 ^ N <0 M K n 00 lA ^ ^ 
ibPOO HOOOOSOOoO ^P00<4OOOON>OO 


1 

999 

009 

016 


I-) fi rH rt 





1 1 1 1 1 1 



1 1 

K| 

(OCOOO OP ^00it)0000M •-<00 (OCICO N ^<0U) (0 <-4 
d^NOMMHupMpgcdioioncopHiONPtOM^^pM 
P^ts'^u)(0OPOOO40OU)OOOOOOOONU)O 

« H il 

D 

K) 

1.000 

.036 

.033 

.000 


III II 1 

Cj 




N^u30u)o«^giOP<onaoon^pM^p^oopQOto 
eorauSN H<OCOp04POO^NO*HpMgU3MPM^M 
OONOOPOOHQOPOOt^OOOOOOCfkOSOO 



03004 Hc^l 

Q CCiH M iH 

ooooo 


H iH 

1 1 1 1 II II 1 



1 1 


000 

000 

000 

000 

000 

ooo 

000 

000 

000 

000 

000 

000 

000 

000 

000 

000 

000 

000 

000 

.000 

ooo 

000 

ooo 

ooo 

ooo 


s 

ooo 

440 

421 

485 

444 

435 







<-( Cl M ^ U3 P N 00 0) O H 09 ^ 1/9 flO P O <*( Cl «g ^ to 

•^Hf^fHrHi-(rii-»f-«f^CIC|CI<SClC| 






.13 

— .06 

1.00 



lOiQCIOlN 

t2SliS29S 

1 1 

.9981 

.9991 

1.0009 



og m 

si 8 

1 


(5 

■QMnag 

23SI2S 

» » 1 t • 

11 


'«5 

t ^ g 

H 

1 


cj 

.448 

— .130 

— .108 

— .845 

— .276 

1.0193 

1.0097 

.9904 


s 

o 01 g 

3C *r 3> 

o o 0> 

1 


e5 

:tOaNN« 

issass 

1111 


1 

s «s 

H 

1 


y 

ejosNooi 

1 1 

N» W 

W« N 

OOO g 
0)0 o 


0 

S 2& 

O C45 



mogeON 

Qoomoio 


>« 

!S S ■-< 

O O H 

1-1 

1 

*3 

N 

e 

II 

«f 

« 

>*1 

.413 
.506 
.606 
— .107 
.305 

.9613 

.9805 

1.0199 

tS 

II 

iS 

19 

^ O N 

mo ^ 

o e H 

H 

1 

*5 

e 

D 

e 


1 1 

S22g8 

<4tiO(OHi< 

1 



lAO lA 

oo o 

H 

1 


•iH 

0'4< 0)0000 

1 1 

<ce) oo 

25!Si 

0)0 o 



iH ijt M 

mo 10 

oo o 

H 

1 



ONOIOS 

1 1 

1 

1 

1 

1 

s 

H 


s 

H 



s 




n 

! 

■ 


■ 

■ 

mH 

nIw<5 
















! 

































THE METHOD OF EXTENDED VECTORS 253 

correlations between the corresponding primary factors are then deter-' 
mined by the formulae that have been described in chapter x. 

In Figures 18 and IS we have the complete set of ten rlifl.Erfl.TnH which 
show the configuration in relation to a set of reference vectors, and there is 
no further indication of adjustments in the reference vectors. This set of 
diagrams is therefore accepted as final for this problem. The matrix Afo 4 of 





Table 11 gives the transformation which carries the given extended factor 
matrix Ea to the final extended factor matrix Ei. The same transformation 
carries the given factor matrix Fo, that was obtained by factoring, into a 
factor matrix Vi, which happens to represent a set of orthogonal axes in 
the present problem. We then have 


(17) 


EfiMoi — Et , 
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which is an alternative for 


(18) 


EiHu = Ei. 


We also have 


(19) 


F(iAo4 = Vt < 
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ter W''™ '“tor ma- 

matrixes Jh f vectors with normal length. This factor 

matrix is used for purposes of interpretation. 

re^cotLTtW^f to find that we have 

T^t fl wfn V "*'^trix with which we started. 

^ be seen that the 

y identical. In making the comparison, we must identify 
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the five columns. The columns Pi to Ps of Table 3 correspond to columns 
Df B, E, A, and C in Table 12. The reason for the arbitrary rearrangement 
of the columns is that in locating the traces of the planes in the diagrams 
and in giving letter identifications to the planes during the rotations we have 
no way of knowing which planes are emerging during the successive rota- 
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tions. Therefore, in making several factorial analyses of comparable test 
batteries, the order in which the primary factors appear in the successive 
columns of the factor matrix is entirely arbitrary. 

When the test vectors are identified by their test names, as well as by 
their code numbers, one learns to identify early in the rotations the well- 
established primary factors. In some problems that are concerned mainly 
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with methodology, the planes are given code numbers, which are relied 
upon exclusively for the location of the traces on the diagrams. In ex¬ 
ploratory factorial studies it is often found that the primary factors are not 
completely determined in some of the diagrams because the test batteries 
in exploratory work seldom reveal a complete simple .structure. It i.s then 
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advisable to use all the information available, including the configuration 
as well os the psychological nature of the tests, to determine the co-errdinato 
planes, which are then interpreted os in the nature of hypotheses concern¬ 
ing the underlying parameters or primary factors. These must then be in¬ 
vestigated with further factorial studies to determine whether one or more 
hypotheses concerning the postulated functional unities can be sustained. 
The purpose of this chapter is to show that when a clear and complete 
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simple structure exists, as in the present fictitious example, the rotational 
methods that have been described enable us to identify the underlying 
order. The example here used was a five-dimensional orthogonal test bat¬ 
tery. The methods of this chapter enable us to handle, in the same manner, 
factorial problems of any number of dimensions in which the underlying 
order is either orthogonal or oblique. 
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CHAPTEE XII 

THE SPECIAL CASE OF UNIT BANK 
The one-column factor matrix 

If a correlation matrix can be accounted for by a single common factor, 
then we have a factor matrix of one column, as shown in Table 1. The fac¬ 
tor loadings can then be denoted with a single subscript, oy for test j. By 
the fundamental factor theorem we have FF'so that the diagonal ele¬ 
ments become Each communality /ij is then simply the square of 

the single-factor loading, namely, aj. In dealing with actual data it is not 
often that one can account for the correlations by a single common factor, 

Talk 1 

Corrdation Matrix 
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ru 
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at 


but this case is of historical interest because it was the case to which stu¬ 
dents of factorial theory devoted almost their entire attention for a quarter 
of a century after Spearman's first provocative paper on this subject in 
1904.* We shall consider the single-common-factor problem as a special 
case of the multiple-factor problem instead of by the statistical methods 
formerly used. We shall refer to some of the controversial issues about the 
single-conunon-factor problem that were debated formerly, and they will 
be discussed here in the light of multiple-factor theory. 

For the case of a single common factor we have 

(1) Tjk — flyO* , 

where oy and a* are the single-common-factor loadings of teats j and k. In¬ 
spection of this equation shows that pairs of columns, k and I, must be pro¬ 
portional. We then have the theorem that ij a correlalional matrix is of unit 

* "Correspondence between General Discrimination and General Intelligence," Part 
III of "General Intelligence Objectively Determined and Measured,” American Journal 
of Psychology, XV (1904), 208-72. 
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rank, then all pairs of columns, or rows, are proportional. The converse of 
this theorem is also true, for if all pairs of columns arc proportional, then 
all minors of second order or higher vanish, and hence the rank must be less 
than 2. The trivial case of rank 0 is here of no significance. The case in 
which the rank is 0 is, of course, identified by tlie fact that all the inter- 
correlations ore 0. That is a case of no scientific interest. We have, there¬ 
fore, the theorem that if all pairs of columns, or rows, of a correlational mairix 
are proportional, then the rank of the matrix is 1 or 0. 

One of the earlier criteria used by Spearman for showing that the inter¬ 
correlations of a set of tests could be accounted for by a single common fac¬ 
tor was the proportionality of the columns of coefficients. Because of sam¬ 
pling errors the proportionality was not exact when experimental data were 
used. A later criterion of the degree of correspondence between pairs of 
columns was the correlation between them. In general, if two columns are 
proportional, their correlation is -{-1 or —1. The degree of proportion¬ 
ality was expressed in terms of the coefficient of correlation. We then have 
the theorem that if the correlational matrix is of rank 1, then the correlation 
between pairs of columns, arrows, is -ff or —1. The converse of this theorem 
is not necessarily true. If the correlation between pairs of columns is -|-1 
or — 1, the columns are not necessarily proportional. A specific! case which 
disproves the converse is that in which a constant is added to each element 
of a column. A linear plot is then obtained which doc-s not pass through the 
origin. The correlation is -f 1, hut the columns are not proportional. 

Spearman’s former use of the intercolumnar criterion depended on the 
converse, in that the high correlation between columns was the boisis for 
the inference that a single factor was sufficient to describe the intercorrela¬ 
tions. While the intercolumnar correlation criterion is demonstrably fal¬ 
lible, it would be a rare situation in which a set of mental tests would satisfy 
the criterion of unit correlation, or very high correlation between columns 
when the rank is higher than 1. Hence Spearman’s use of the correlation 
criterion could be defended. 

But another type of difficulty appeared with the intercolumnar correla¬ 
tion criterion. If all the coefficients in R are of the same order of magnitude 
and if these are overlaid with sampling errors, then the dispersion of a col¬ 
umn may be comparable with the sampling errors, and the correlation be¬ 
tween columns may be low because of the restricted range of the entries in 
the correlation matrix. The proportionality would still bo maintained with¬ 
in sampling errors, but the points in each correlation table would be so re¬ 
stricted in range that the correlation coefficient would not reveal the pro¬ 
portionality. The intercolumnar proportionality criterion is therefore su¬ 
perior to the intercolumnar correlation criterion. 

The limiting case of this effect is of some interest. If all the coefficients 
in a correlation matrix are equal, then the proportionality criterion is satis- 
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lied, but the correlflition coefficient is indetemunate. The proportionality 
criterion would give the correct inference, namely, that the correlation ma¬ 
trix is of rank 1. We then have 


( 2 ) 

But 


r,* = , 

Tkl = 0*01 , 
. T “ 0,^1 • 


(3) 


rjk = Til = m , 


and hence 

(4) OijGk " OjO| = , 

and 

(5) Oj = Ok = Qi. 

It follows from (1) and (4) that 

(8) oy = o* = Oi = Vryjt. 

This limiting case is represented in the theorem that if all the coefficients 
r jk in a correlation matrix are equal, then the matrix is of unit rank, and each 
test has a single-factor loading of V^. 

If sampling errors are superimposed on this limiting case, the correlation 
between columns shows only the correlation between random errors. This 
correlation should be zero or near zero. The intercolumnar proportionality 
criterion is still valid, and it would be only slightly affected by the sampling 
errors in a finite test battery. 

Spearman’s use of the correlational, rather than the proportionality, form 
of the intercolumnar criterion was determined, probably, by the fact that 
the standard error of a correlation coefficient could be determined, whereas 
the proportionality form of the criterion would require the development of 
an appropriate standard error formula. There does not seem to be any fun¬ 
damental difficulty in developing such a formula. 

Since the diagonal values of the correlation matrix are frequently dis¬ 
cussed in factor analysis, it is useful to know the theorem that if a correlation 
matrix is of unit rank and if the diagonal elements are unity, then all elements 
in the matrix are -|-f or —1. 

It is sometimes useful to note a restriction on the numerical values in a 
single-common-factor correlation matrix. It can be stated in the theorem 
that when the rows and corresponding columns have been reversed in sign so 
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that all the coefficients in a single-common-Jactor correlation matrix are -positive, 
then the three eide correlations of any third-order principal minor are such that 
any one of them is greater than the product of the other two. This property fol¬ 
lows directly from the proportionality of the columns and the further re¬ 
striction that the diagonals are positive numbers that do not exceed unity. 
We then have 

rti _ fga 
ri3 r23 

But 7'a2 = A 2 <l| so that 

rtar 28 ^ 

rij ’ 

and hence 

TiiTti < r\i . 


If a set of three tests have intercorrelations that do not satisfy this restric¬ 
tion, then a diagonal value is greater than unity. Such a set of three tests 
can be a part of a correlation matrix of rank that is higher than 1. 

The number of tests for unit rank 

It is useful to inquire how many factors can be determined from the in¬ 
tercorrelations of any given number of tests or measures. Here we arc con¬ 
cerned about the number of tests which are necessary to determine a single 
common factor. In a correlation matrix of n tests we have 


in{n — 1 ) 

independently determined correlation coefficients, because these include 
only the side correlations and not the diagonal or self-correlations, which are 
unknown. In Tdble 1 we see that for rank 1 the diagonal elements are simply 
the squares of the factor loadings, which are the unknown communalities. 
The corresponding factor matrix has a single column with n factor loadings. 
We cannot expect to determine n factor loadings unless we are given at 
least as many independent correlation coefficients. We then have 


(7) 
or 

( 8 ) 


n(n — 1) 
2 


> n, 


n > 3, 


by which we infer that at least three tests are necessary to determine a single 
common factor. In that case we have three unknown saturations a,' to be 
determined whose squares are the unknown communalities h^=a). We have 
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also three intercorrelations, namely, ry*, ryj, tki. The solution of this case 
can be found from the three intercorrelations, 


(9) 

rjh = ajGk , 

(10) 

ryj = oyoi, 

and 


(11) 

Tki = aydi . 

Divide (10) by (11). Then 


(12) 

lii = fk 

Tkt Ck ' 

so that 


(13) 

„ a/Tki 

ak = . 

Til 


Substituting (13) in (9), we have 


(14) 


Tik = 


a)rki 

Tjl 


t 


from which we have Spearman’s formula* for the correlation of test j with 
the single common factor, namely, 

05 ) 

in which Oj is the factor loading of test j. The correlation ryi between test j 
and the single common factor is the factor loading ay, so that ryi = ayi. 

The intercorrelations of three tests can usually be accounted for by one 
common factor, but such is not always the case. Consider the two correla- 


TaUe e 


— 

.14 

.25 

— 

.14 

.14 

— 

.60 

.14 

— 

.25 

.50 

ip) 


.35 

.50 

(6) 


tion matrices (a) and (b) in Table 2, which have been used by Wilson and 
Worcester to show that the correlations between three tests cannot always 
be accounted for by one common factor, t The correlation matrix (o) is of 

* O. Spearman, The AbilUies of M<m (New York: MacmlUan Oo., 1927), Appendix, 
p. xvi, eq. (19). 

t E. B. Wilson and Jane Worcester, "The Resolution of Tests into Two General 
Factors,” Proceedings of the National Academy of Sciences, XXV (January, 1939), 24, n. 8. 
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rank 1 if we insert the communalities .07, .28, .89, which determine the 
single-common-factor loading.s. The matrix (b) i.s of rank 1 if we insert the 
diagonals .008, .20, 1.26; but, since one of thc.se is greater than unity, the 
solution is incorrect. Matrix (b) can be comsitlorcd as a correlation matrix 
of rank 2, and there will be two general common factors. In this case the 
resolution into factors is, of course, not unique. 

The value of a,- as determined by equation (If)) i.s subject to fluctuation 
with the sampling errors of the three correlation coeflieients in terms of 
which it is expressed. It is desirable to minimize this effect by taking an 
average value for aj based on different pairs of to.st8 k and I, with which test 
j is combined. With n tests, the number of way.s in which (15) can be writ¬ 
ten for test; is the number of pairs of tests that may bo taken from the re¬ 
maining (n—1) tests, excluding test j. Hence the number of ways in which 



(16) may be written is Kn-l)(n-2). The total number of formulae (16) 
for ascertaining all the single-factor loadings for n tests is in(a—l)(n—2). 
If we have twenty tests, then formula (1.5) can be evaluated in 3,420 dif¬ 
ferent ways in determining the correlation of each of the twenty tests with 
the single common factor. 

We have seen that three tests are required in order to determine a single 
common factor. It is of some interest to see the nature of the indeterminacy 
when only two tests are available. Consider Figure t, in which are shown 
the two test vectors, j and A. The correlation between tc-sts j and k can be ex¬ 
pressed as the scalar product of the two tc.st vectors, so that 

I'ik = hjhk cos <l>fk ; 

but the figure cannot be drawn uniquely unless we know three things, name¬ 
ly, the two vector lengths and their angular separation. The same correla¬ 
tion is represented in Figure 1 by the pair of vectors j and ft', where the 
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angle and the communaUty of k' are both altered bo as to retain the same 
given scalar product or correlation. The case of one test determines an axis 
that may be defined as collinear with the test itself, but the problem of com¬ 
mon factors does not appear except for two or more tests. If equation (16) 
is interpreted for one dimension or common factor, then the cosine of the 
angle is, of course, unity, and we have two communalities which cannot be 
determined by a single correlation coefficient. We see, therefore, that two 
tests do not define a single common factor. 

Students of factor analysis who confined their attention primarily to the 
single common factor have used sets of four tests to determine the common 
factor. The reason for this is that, in general, three tests determine a single 
common factor uniquely, since there are three intercorrelations to deter¬ 
mine three factor loadings. Hence nothing is proved scientifically by doing 
it. A scientific demonstration of any kind must always be overdetermined 

Table S 
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2 

3 

4 

1 

+ .64 

-.66 

+ .48 

-.40 

1 

.64 

.66 

.48 

.40 

2 

-.56 

+ .49 

-.42 

+ .36 

2 

.56 

.49 

.42 

.36 

3 

+ .48 

-.42 

+ .36 

-.30 

3 

.48 

.42 

.36 

.30 

4 

-.40 

+ .35 

-.30 

+ .26 

4 

.40 

.35 

.30 

.25 


by the data in order to be convincing. Hence the smallest number of tests 
by which a single common factor can be demonstrated is four. Of course, 
the larger the number of tests in the correlation matrix, the more convincing 
will be the demonstration of a single common factor, assuming that the 
variables are otherwise properly chosen. 

The case of rank 1 requires that aU the correlation coefficients be positive 
or that they can be made positive by reversal of one or more of the meas¬ 
ures. Consider, for example, the correlation matrices in Table 3, which 
are both of rank 1. The absolute values are the same. The first matrix can 
be transformed into the second by reversing the signs of the second and 
then the fourth variables. Each reversal represents a reversal of a column 
and then the corresponding row. The reason for this arrangement for ;rank 1 
is that the test vectors are collinear and they may be reversed in direction. 

The tetrad difference 

Spearman’s later method was to evaluate what are called "tetrad differ¬ 
ences.” The tetrad difference is of the form 


(17) 


TkmXln TimTkn ” P > 
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where k and Z refer to two rows, while 7n and n refer to two columns of R, 
The four subBcripts refer to as many tests, and it is implied that four sepa¬ 
rate tests are involved in the tetrad difference equation. Heiuie the tetrad 
difference is not written so as to include any diagonal terms of E. This is 
consistent with the fact that the communalitic-s arc unknown. Spearman 
has shown that if only one factor is involved, then all the tetrad differences 
in R vanish. 

The tetrad differences have a very simple matrix interpretation. They 
are simply the expansions of second-order minom in the correlation matrix. 
If the rank of R is 1, then all second-order minors vanish. The converse is 
also true; for, if the second-order minors vanish, then the rank must be 1, 
except for the trivial case when all entries are 0. The matrix interpretation 
of Spearman’s tetrad difference procedure is that unit rank (i.e., a single 
common factor) is established by evaluating separately the second-order 
minors in the correlational matrix. 

To establish that a matrix is of any particular rank r, it is, of course, nec¬ 
essary to prove that r is the highest order of the non-vanishing minors. 
Taken literally, this requires that all minors of order higher than r must be 
shown to be 0; but for computational purposes this is probably the most 
awkward way possible, especially for the single-common-factor case. 

The tetrad difference method of examining a correlation matrix cannot 
be recommended even for the restricted singlc-common-factor case to which 
it is theoretically applicable. The reason is that more effective methods are 
available for ascertaining whether one common factor is sufficient to ac¬ 
count for the intercorrelations. If more than one factor is required, then the 
tetrad difference criterion is not applicable. Betiause of historical interest, 
some of the properties of the tetrad differences will be described hero.* 

Because of the great amount of labor that is involved in the computation 
of the tetrads for a large correlation matrix, it is convenient to know how 
many tetrads must be evaluated for n tests in order to cover the whole 
table. Since a tetrad difference is the value of a second-order minor which 
does not contain diagonal terms, there are as many tetrads as there are 
second-order minors which do not involve the diagonals. Each of these 
minors is defined by two rows and two columns. The number of pairs of 
rows that can be taken is the number of combinations of n things taken 
two at a time, or 

(18) (jn = 1) ^ 

A 

♦ Tetrad differences are no longer in general use. The single-factor methods have been 
replaced by multiple-factor methoda of analysis by most students of factorial theory. 
This WM not the case when the matrix interpretation was introduced in 1032 or when the 
fiiBt edition of this text was published in 1935. 
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The nuniber of possibls pairs thEt ceq bo tsiken from the rsmEining col- 
umnSj since diagonal elements are excluded, then is 

(19) c;-® = ~ ~ . 

Hence the total number of second-order minors in the correlation matrix, 
excluding diagonals, is 

(20) C;Cr® = ~ 2)(n - 3) 

4 

But, since the correlational matrix is symmetne, it follows that every one 
of these minors is duplicated by a symmetric minor of the same value. 
Hence the total number of different tetrads is 

(21) 4CSC;-* = ~ - 2)(n - 3) ^ 


Since every set of four variables gives three tetrads, it is possible to obtain 
the same result by considering the number of combinations of n things taken 
four at a time. Then the number of tetrads is 

(22) 3CJ = - 1)(^ - 2)(^ - 3) ^ 

8 


Example ; If the number of tests is 20, then the correlation matrix con¬ 
tains 14,535 tetrads. 

When the computation of all these tetrads has been made, the result is 
usually that the tetrads do not vanish. The inference must then be made 
that one common factor is insufficient to account for the intercorrelations 
of the tests. If it is found that the tetrads do vanish within the sampling 
errors, then the next problem is to ascertain how much of the variance of 
each test is attributable to the single common factor. This can be done in 
terms of the correlation coefficients by Spearman’s formula (15). 

Spearman’s procedure takes into consideration that the tetrad difference 
in (17) does not quite vanish because of sampling errors in the four correla¬ 
tion coefficients. If a single common factor is fundamentally present ond.if 
the four coefficients have known standard errors, an expression for the 
standard error of p can be derived. This has been done by Wishart and by 
Holzinger.* The experimentally observed deviations of p from zero should 
not exceed those which might be expected from the standard errors of p. 

* John Wiahart, "Sampling Errors in the Theory of Two Paotors," British Journal of 
Psychology, XIX (1Q2S), 180-87; Karl J. Holzinger, Stalistiajl- Risumi of the Spearman 
Two-Factor Theory (Chicago: University of Chicago Press, 1030), pp. 6-16. 
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This is the central idea in Spearman's single-cominon-factor method. The 
tetrads in a correlation matrix are first evaluated. A frequency distribution 
of these tetrad differences is then made and its standard deviation deter¬ 
mined. If this dispersion is of an order of magnitude comparable with that 
which would be expected from the known standard errors tjf the tetrad 
differences, then Spearman draws the legitimate conclusion that a single 
common factor is sufficient to account for the observed intercorrelations. 
Applications of formulae of type (15) give the loading of each t&st with the 
single common factor whose sufficiency has been established by the fact 
that the tetrads vanish within sampling errom. In order to reduce the labor 
of computing probable errors of the tetrads, Spearman and his students have 
developed several abbreviated procedures. These are limited, however, to 
the single-common-factor case. 

Factorial reduction to unit rank 

There are several types of situations which arc of bf)th theoretical and 
practical interest, in which a factor matrix or n correlation matrix is reduced 
to rank 1. Consider, first, the two-column fa<'t()r matrix in Table 4. If the 

Table 4 


Faeior Matrix F Sinffle-Factor Matrix 



I 

II 


1 

1 

.60 

.30 

1 

.6708 

2 

.40 

.20 

2 

.4472 

3 

.80 

.40 

3 

.8044 

4 

.20 

.10 

4 

.2230 

6 

.30 

.Ifi 

r> 

.3354 


matrix F is multiplied by its transpo-se F', it will be seen that the columns 
in R are proportional and that it is of rank 1. The tetrads vanish, and the 
intercorrelations of the tests can be described a.s well by one factor, as 
shown in the single-factor matrix. 

The reason why this result is obtained is that Matrix F is of unit rank. 
It corresponds to the conceivable psychological situation in which each test 
of a battery calls for two primary mental abilities in the same ratio, al¬ 
though they differ in specificity and reliability. In practice, it is pr)8sible to 
select from a large table of tests several groups whose intercorrelations are 
high when corrected for uniqueness. Each one of these groups of tests can 
be described in terms of one factor, but that factor is not necessarily psy¬ 
chologically significant. The tests may bo composites, os illustrated in the 
two matrices. One way of avoiding this ambiguity is to work with several 
abilities or factors simultaneously, as is done in the multiple-factor methods. 

The simple illustrative case that has been described here can be general- 
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ized into a useful theorem, namely, that if two columns of any factor 
mairix are proportional, then the two columns are of unit rank, and the 
rank of the factor nmtrix is correspondingly reduced. It can be easily seen 
that this situation is more likely to occur in analyzing a small test battery. 
Two factors that are actually distinct may then collapse so that they appear 
in the analysis as a single factor, with consequent confusion or error of 
interpretation. Only by further investigation of the same domain would 
the error be discovered. It is quite likely that this does happen in explora¬ 
tory factorial investigation where the domain covered by several factors is 
not adequately covered by testa. With these limitations of method the solu¬ 
tion seems to be to explore rather intensively each domain with a large num¬ 
ber of specially constructed measurements until the factorial composition 
of each new test can be anticipated with confidence. 

Godfrey Thomson has discussed a very interesting case of reduction in 
rank in his sampling theory. Consider a factor matrix of order «Xn,, in 
which each test of unit variance is defined only in terms of the number of its 
elements, namely, n,-. Let there be a total of ni elements involved in the 
domain defined hy the factor matrix. Then, in the row j, we have nj fac¬ 
tor loadings o,- distributed at random, and the remaining factor loadings 
are zeros. If each test is of unit variance, we have 

(23) Daf = 1 ; 


but, since there are ra,- non-vanishing elements in row j, we have 

(24) rtya| = 1, 
so that 

(25) aj = - y- . 

Vnj 

Let similar notation designate test k. Then the correlation ry* will be 
the cross product of the two rows j and k. The probability that there will 
be non-vanishing cell entries in the same column for both rows j and k is 
PjPk, where 

(26) ^ P* = ^' 

7lt Tit 

so that 


P'-P* - ■ 


(27) 
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The correlation rjii then is 


(28) 


’■jt = JhVk(Wi, , 


which reduces to 
(29) 


rjt 


_ V/lym 


but this is the well-knoAvn ctusc of the coritihitiim cxpressml in tonna of com¬ 
mon elements. It can be expressed us the product (jf the single factors A- 
and At, where “ ’ 



so that the correlation matrix is of unit rank. Thi.s result is approached as 
n, becomes large. Here we have the case in which a factor matrix with a 
large number of columns constructed in the inauner described, ap¬ 
proaches unit rank. It is quite another matter to dticide whether this type 
of factor matrix is psychologically plausible for the dc.s(!ription of mental 
traits and teat performances. 





1 

S 

3 

i 

& 

1 


.50 

.48 

.41) 

.32 

2 

.56 


.42 

.35 

.28 

3 

.48 

.42 


.30 

.24 

4 

.40 

.3.5 

.30 


.20 

5 

.32 

.28 

.24 

.20 


s 

1.76 

1.61 

1.44 

1.25 

1.04 


Graphical analysis of tetrads 

If one IS interested in the task of tabulating separately tho value.s of all 
the second-order minors in a correlation matrix whitdi Spearman has called 
the tetrads, then some simple graphical methods might be useful. Because 
the proportionality of the columns and rows in this case wo see that, if 
the correlational matrix is of rank 1 and if any column k i.s plotted against 

PXfimn **1® Single-factor loading of tost k to that of test I An 

inaSx o/ro6te 

are^ad*™ thm ^ diagram represent tests m and n. If the two points 


(31) 


'’’In ri,^ 
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so that 

(32) r4„rj„ — = 0 . 

If the points m and n are not radial, the proportionality of (31) does not 
obtain, and the tetrad (32) does not vanish. By this simple graphical meth¬ 
od one can identify the tetrads that do not vanish. 



Fianite 2 


If the te.st battei'y as a whole cannot be described by a single common 
factor, the plot will not be linear but will scatter, as shown in Figure £. 
This figure .show.s the plot of column 9 against column 1 from a correlation 
matrix in a factorial investigation by William Brown and WiUiam Stephen¬ 
son.* Column 9 represents a teat of pattern perception, and column 1 rep¬ 
resents a test of inventive synonyms, Although it is evident in Figure 2 that 

* "A Teat of the Theory of Two Factors," British Journal of Psychology (Gen. Sec.), 
XXIII (1935), 362-70. 
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a Binglft factor is not sufficient to account fur the intei-forrclations and that, 
therefore, all the tetrads do not vanish, it is still possible for smaller groups 
of tests to be of such a character that their intercorrelations can be de¬ 
scribed by a single common factor. Their tetrads should then vanish. The 
smallest group for which a tetrad can be written is four tests. Two tests 
are represented by the two columns that are plotted. Any pair of points 
on the diagram determines a tetrad. If they lie in a radial line through the 
origin, the coiresponding tetrad vanishes. If they do not lie in a radial line 
through the origin, the corresponding tetrad does not vanish. 

Figure 8 gives further information about the possibility of a single-factor 
hypothesis for the tests concerned. Radial lines can be drawn through 8 
and 17, through 18 and 19, through 6 and 14, with small residuals. Any 
one of these three pairs can be combined with tests 1 and 9 to form vanish¬ 
ing tetrads, but it does not follow that all eight of the tests can be included 
in a single-factor correlation matrix. The fact that the points spread on 
different radial lines means that other tetrads whicli include te.sts from dif¬ 
ferent radial lines will not vanish. It should be carefully noted that, if the 
tetrads fail to vanish, we can say that one factor i.s not .sufH(‘ient to account 
for the correlations, but it still remains a possibility that a Spearman gen¬ 
eral factor is present in addition to other factors, so that more than one 
factor is required for the battery of tests as a whole. We sec, therefore, that 
the tetrad criterion is inadequate for disproving a Spearmaji general factor. 
See^ for example. Figure Sb and Figure 6 of chapter ix, which illustrate 
three-dimensional configurations that include an orthogonal general factor, 
which we are here calling a “Spearman general factor.” The tetrads do not 
vanish for such a test battery, but it contains a Spearman general factor. 
Neither do the tetrads give any information about the existence of a sec¬ 
ond-order general factor, to be discussed in chapter xoiii. 

Spearman’s terminology 

Spearman’s hypothesis that the correlations between psychological tests 
can be accounted for by a single general intellective factor has been known 
as the theory of two factors. The general factor was denoted g. In giving this 
name to his theory, Spearman had in mind two facstora, namely, a general 
intellective factor and a specific or unique factor in each test. As long as 
factorial investigation was dominated by the central theme of the general 
intellective factor, Spearman’s formulation could be called a theory of two 
factors, one common and one unique. With the extension of factor analysis 
to n dimensions and with the principal scientific interest directed to the 
multiple common factors, it is confusing to speak of Spearman’s theory of 
two factors, one common and one unique. In order to avoid confusion 
we shall speak of Spearman’s theory of a single common factor, a terminology 
that is consistent with that of multiple-factor analysis. 
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When Spearman found a set of tests for which the intercorrelations were 
proportional, he called the table a hierarchy. Such a table had the charac¬ 
teristic that the highest correlations could be placed near the upper left 
corner and the lowest correlations in the lower right corner. Much of the 
early debate ab(jut the q\ie.stion of whether Spearman’s single general in¬ 
tellective factor was adequate to account for the observed correlations be¬ 
tween tests turned about the statistical question as to whether the tables 
of intercorrelations exhibited so-called hierarchical order. The table of cor¬ 
relations was not treated as a matrix, and the question of its rank was not 
discussed in relation to this problem.* 

Before multiple-factor analysis was introduced as an explicit psychologi¬ 
cal method without any assumption that there should be a single dominant 
general intellective factor, there was frequent discussion of other factora 
besides the general intellective factor g. These other factors were regarded 
as secondary to the general factor g. They were described as the “disturb¬ 
ers” of the tetrad equation, and they were avoided by eliminating similar 
tests from the battery. For example, if two number tests were in a battery, 
their correlation would add a number factor to the common-factor vari¬ 
ance, and the tetrad equations were consequently not satisfied. Instead of 
adding more number tests to the battery in order to investigate number 
ability, the preferred procedure was to keep only one of the number tests in 
the battery, eliminating the others. The number factor was thereby rele¬ 
gated to the unique variance, and the tetrads were undisturbed. Whenever 
these additional and disturbing factors were investigated, the accepted pro¬ 
cedure was, fiiut, to extract a general factor which dominated factorial 
studies. Then the residuals were investigated in groups for additional 
factors. These were always treated as secondary and residual to the domi¬ 
nant general factor g. This type of factorial analysis is still current among 
British psychologist.s. Most of them have not yet adopted the multiple- 
factor methods, which include extraction of multiple factors and rotation 
of the reference frame to a simple structure. The newer methods leave it as 
a question of fact whether a general factor is in the battery and whether it 
is an orthogonal general factor or a second-order general factor. 

Special factoring methods for unit rank 
Spearmayi's single-factor formula 

We shall con.sidor, first, Spearman’s formula for factoring a correlation 
matrix of unit rank. The singlc-common-factor loading of each test may be 
determined by a summation procedure. This method is simpler than the 

* L. L. Thurstono, Theory oj Multiple Factors (Ann Arbor, Miob., 1033), pp. v, vi, 20. 
This publication is out of print, but it can be obtained at the University of Chicago 
IJbrary as microfilin document No. 1048. 
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tetrad method for a single common factor, and it ^ives more information 
about the variables than the tetrad differences give. 

If the correlation r can be described by a .single common factor, we have 

( 1 ) rjk = a,ai:. 

The sum of column k in the correlation matrix is 


n w 

(33) 

j-i 

Since the diagonal terms are unknown, the summation in the left member of 
(33) ia unknown, and hence not suitable for computing purposes. Let (r) k be 
the sum of column k, omitting the unknown diagonal entry. Then 


(34) 

and hence 

(35) 


('■)/: = '^rjk - tti , 
i*l 

n 

(r)* = - al. 


Summing for all given coefficients in Ra and omitting the unknown diag¬ 
onals, we have 

(36) (r) i = X ~ X ’ 

or 


(37) 


(r).= 



n 



kn i 


where (r)(S (r)*; denotes the sum of all tiic coofficicnl.s in Hu e.\cept the 

h 

diagonal ones. 

Each of the two terms in the right member of (37) may b(! cxpre.sHed in 
terms of summations of known coefficients, an follows: 


( 1 ) 

and hence 


Tjff — djUjt , 


(38) 
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Summing for column k, we obtain 
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(30) - Va,, 

j 

and, from (84), it follows that 


j=i j=i 


(40) 


or 


(41) 


^[(r)/: + at] = ^o# 

}~i 


ait 


•• 

+ = ^aj = 


i=i 4=1 

Hence the first term of the right member of (37) is 

12 


(42) 


4=1 


= ^-' + 2(r)* + 4. 


The hist term of (37) may be expressed in terms of summations of coeffi¬ 
cients, as follows: 


( 1 ) 

so that 

(43) 

and hence 

(44) 


Vfti — djO/k f 


7% = aX, 


“a 


Summing for (•oliinni fc, wc have 

^ jni j»ml AhI 

Summing for column k, except for the entry in row k, we have 


(46) 


2 

a? 


j=i 




I“1 
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Let the sum of the squares of the known coefficients in column k be denoted 
by (r®)*, so that 

n 

(47) {r-)k = r't^ . 

Then (46) can be written in the form 

(48) 

*-i 

Substituting (42) and (48) in (37), we obtain 


(49) 


(r)i = + 2(r)« + al- - a? , 

aje az 


or 

(60) (r), - 2(r)k 

from which it follows that 


(r).l _ (L')* 
4 4 


(61) 

where 


- WE - (/•»)* 

(r),-2(r)*’ 


(r)* = the sum of the coefficients in colinnn Jc, omitting un¬ 
known diagonal entry, 

(r)E = the square of (r)*, 

(r*)*; = the sum of the squares of the known coeffitdonts in col¬ 
umn k, 

(r)i = the sum of all known coefficients iir the fiorrelation ma¬ 
trix . 


Formula (61) gives the single-common-factor loading of each test in a 
correlation matrix of rank one. This formula has been given, in different 
notation, by Speannan. * 

In Table B we have a small correlation matrix «»f unit rank. To find the 
factor loadings for the first test by Spcarniau’u formula (61) wo have 

(r)i = 1.7600, (r=)i = .8064, 

(r)E = 3.0076, (r), = 7.1000, 

which when substituted in Spearman’s foimula (61) give Oi = .80. By the 
same method we get aa = .70, a, = .60, a* = .50, and Ug = .40. 

* The Abiltiies of Man, Appendix, p. xvi, eq. (21). 
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A logarithmic solution 

Another direct method of solving the single-factor problem is the logarith¬ 
mic solution.* The logarithmie formula is 


(52) 


log a* = 


2(n - 1) Tik - 

rjk 

2(n - 1)(» -2) ' 


where j k. For Spearman’s formula (51) the square of each correlation 
coefficient must be listed, and for the logarithmic fonnula (52) the logarithm 
of each coefficient must be listed. The logarithmic fonnula is not applicable 
when some coefficients are near zero, in which case the large negative 
logarithms unduly weight the determination. 


A direct summation method 

A third direct method of determining the factor loadings for rank 1 can be 
derived from the graphical representation of proportional columns. If one 


Table e 



1 

3 

3 

4 

s 

2 

1 


.86 

.48 

.40 

.32 


2 

.m 


.42 

.35 

.28 


3 

.48 

.42 


.30 

.24 


4 

.40 

.lib 

.30 


.20 


6 

.32 

.28 

.24 

.20 



s* 

1.70 

1.01 

1.44 

1.26 

1.04 

7.10 St 

r*i 

1.70 

1.05 

.00 

.85 

.72 

5.34 (*(— 

si-rw 

1.70 

1.20 

1.28 

1.30 

1.44 

7.04 (»—l)ii 

at/ai 

1,000 

.87.*! 

.750 

.026 

.500 

3.750 c/ai 

al/flf 

1.000 

.70.00 

.5625 

.3000 

.2600 

2.0687 D/aJ 

Oh 

,80 

.70 

.60 

.60 

.40 

c 


column 1: i.s plotted against another column I, the slope is the ratio of a* to ai. 
For a correlation matrix of order »Xn, there will be (n—2) points in such a 
plot because the diagonal entries arc unknown, being the squares of the 
quantities .sought. The slope can be determined by the method of aver¬ 
ages, as 


(53) 


~ I'kl 

at 3t — Tki ’ 


where s* and sj denote the sums of the known coefficients in columns k and 1. 
A numerical example is shown in Table 6, In the first summation row we 
have the sums s*, and the total is Si, which here denotes the sum of all 
the known coefficients in the matrix. In the next row record values of 
(sfc — rjti). The sum of this row is (sj — Si), by which the summations can 
* For proof see Thiirstone, op. cil,, p. 82 . 
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be checked. In the next row record values of (si — rtj). The sum of this 
row is (n — l)si, by which that summation is checked. In the next row 
record the ratios ot/ai by equation (53). In the next row record the squares 
of these ratios. 

The square of the sum of the factor loadings is equal to the sum of all 
the coefficients in the correlation matrix, including the diagonal correla¬ 
tions {chapter viii, equation [9]). We then have 



Let the sum of the factor loadings be denoted c and the sum of their squares 
V, which is also the sum of the unknown diagonal coefficients or communali- 
tics. We then have 


(55) 

-I- » 

and 


(56) 

c = 2“'’ 

*' 

so that 

/ 

(57) 

-h u = (? , 

Divide (57) by a\, then 


(58) 

^ 

oj af cj' 

Hence 


(59) 



y [aj [af) 


in which all numerical values are known except Oi. Applying this multiplier 
(oi = .8 by equation [51]) to the row a*/oi, we get the factor loadings o*, 
as shown in the last row of Tohle 6. 

Successive approximations 

In addition to direct methods, there are several methods of successive 
approximation. One of these is to imert trial values in the diagonal cells 
and then determine the factor loadings by the centroid method. The squares 
of the factor loadings so determined are used in the diagonal cells for a new 
trial, and the process is repeated until the factor loadings are found to any 
required degree of consistency. For small correlation matrices the approxi¬ 
mation methods require more trials than for larger correlation matrices. 
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For large tables of twenty or more variables, the first trial is usually close 
enough for practical purposes. 

When the centroid method is applied to the case of rank 1, there is no 
problem concerning the reflection of test vectors or the changing of signs, 
and the method is then reduced to its first step, namely, the summation 
for each column of the correlation matrix. It is assumed here that if there 
are any negative coefficients in the table, the corresponding columns and 
rows have been reversed in sign so as to make all the coefficients positive. 
If this cannot be done, then the correlation matrix is certainly not exactly 
of rank 1. The first-factor loadings are then determined by the summa¬ 
tion formula 

(60) 

which is equation (16) of chapter viii. Here the first-factor loading for test k 
is determined by r*, which is the sum of column k, including the estimated 
diagonal, and r<, which is the sum of all the coefficients in the correlation 
matrix, including the estimated diagonal values. This first step of the cen¬ 
troid method is identical with a formula described by Cyril Burt for a cor¬ 
relation hierarchy. The principal feature of the centroid method, which 
was devised for multiple-factor analysis, is the treatment of residuals by 
reflection of test vectors and corresponding sign changes in order to avoid 
the circumstance that the column sums of the residuals vanish identically. 

In using the centroid method for the case of rank 1, we must estimate 
the diagonal values, and consequently the solution depends on taking trial 
values, which require successive adjustment until the solution is found to 
any required degree of accuracy. The adjustments are small when large 
correlation matrices are used. This procedure is theoretically incorrect, if 
it is the intention to extract further factors from the residuals. In that case 
the firat-factor determinations again become subject to adjustment with 
new communalities in the diagonal cells. 

Hotelling’s iterative method of factoring can be applied to the case of 
unit rank, but it requires several trials for the successive adjustment of 
the diagonals which become communalities when the correct solution has 
been obtained. This .solution has the characteristic, when applied succes¬ 
sively to a case of unit rank, that the resulting factor loadings minimize 
the squares of the residuals of the side correlations. The residuals for the 
diagonal entries are zero when the correct values have been found. 

Limitations of single-factor formulae for multiple-factor analysis 

In dealing with actual data it is always a question of fact whether any 
given table of intercorrelations is of rank 1. When a correlation matrix is 
to be analyzed with the assumption that it is of unit rank, it is, of comse, 
implied that only one factor needs to be extracted. The values inserted in 
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the diagonal cells are then the squares of the factor loadings. If the diagonal 
values are know, then the factor loadings are also known. In the special 
case of rank 1, it is possible to solve directly for the diagonal values, which 
are the squares of the desired factor loadings. Several such methods have 
been described here, and others could be devised. In practice such methods 
are not of great importance because it is rare that a correlation matrix has 
a rank as low as 1. 

The student should be cautioned that if he solves for the first-factor 
loadings by any of the single-factor formulae, and then attempts to extract 


Table? 

Correlation Matrix 



1 

2 

3 

4 

6 

1 


.50 

.41 

.30 

.21 

2 

.60 


.58 

.44 

.34 

3 

.41 

.58 


.54 

.67 

4 

.30 

.44 

.54 


.62 

5 

.21 

.34 

.57 

.62 

W* 

1.42 

1.86 

2.10 

1.90 

1.74 

(ro* 

(r)l 

.6522 

.8060 

1.1210 

.O.'iOO 

.8000 

2.0164 

3.4596 

4.4100 

3.6100 

3.0276 

a* 

.2360 

.4838 

.6824 

.5077 

.3806 

O'M 

.40 

.70 

.83 

.71 

.62 


0.02 = (r), 


l>y equation (SI) 


Factor Matrix 



1 

II 


1 

.1 

.6 

.37 

2 

.2 

.8 

.68 

3 

.5 

.6 

.61 

4 

.6 

.4 

.52 

5 

.9 

.2 

.85 


First-Factor Residuals 



1 

2 

3 

4 

6 

1 

.16 

.16 

.00 

-.05 

-.09 

2 


.00 

-.06 

-.09 

3 

.00 

.00 


-.05 

.06 

4 

-.05 

-.06 

-.05 

.18 

5 

-.09 

-.09 

.06 

.18 


additional factors in the same manner from the residuals, the solution will 
be theoretically incorrect. This fact is of considerable theoretical signifi¬ 
cance, and it may be worth while to give a numerical example to show the 
nature of this error. 

In TMe 7 we have a factor matrix for five variables and two factors. 
The communalities are listed in the last column of the factor matrix. Fig¬ 
ure 3 shows a plot of the two-dimensional configuration. The correspond¬ 
ing correlation matrix is also shown in Table 7, Now suppose that this corre¬ 
lation matrix is analyzed by one of the single-factor formulae. We have 
taken Spearman’s formula (51) for this example. The first-factor loadings 
are shown in the row a*, and the squares of these loadings are also listed. 
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By using these factor Ibadings we can compute a table of first-factor residu¬ 
als, as shown at the bottom of Table 7. 

The correlation matrix was constructed so that it is of rank 2. After ex¬ 
tracting one factor, the first-factor residuals should be of rank 1, but inspec¬ 
tion of the residuals shows that such is not the case. Furthermore, the 
square of the first-factor loading of the third variable is higher than the 
coinmunality of that variable for two factors, as shown in the given factor 
matrix. The square of the factor loading is .68, as determined by the single¬ 
factor formula, whereas the communality is only .61. Therefore, there exists 
no axis in the configuration of Figure S on which the five teats have the 


jr 



projections given by the single-factor formula, These factor loadings are 
therefore impossible if the rank is assumed to be higher than one. The only 
way in which the single-factor formulae can be justified is to regard them as 
single-factor descriptions of the correlation matrix, in which case the first- 
factor residuals are regarded as variable errors. If the attempt is made to 
analyze the correlations as due to more than one factor, then the conrniu- 
nalities must be adjusted to fit the higher rank. Any valid factoring for¬ 
mula should give a set of factor loadings which are the projections of the test 
vectors on an axis in the configuration. The same idea can also be expressed 
by saying that the factor loadings should be linear combinations of the col¬ 
umns of correlation coefficients. The single-factor formulae give correct 
factor loadings, or approximations to them, when the correlation matrix is 
regarded as of unit rank or as an approximation to that rank. 



CHAPTER XIII 

THE UNKNOWN COMMUNALITIES 


Nature of the problem 


The coinmunality of a teat ia its comuujii-factor variance. The comple¬ 
ment of this variance is the uniqueness of the test, as previously defined 
The term "communality”* was adopted to distinguish the common-factor 
variance from the reliability coefficients, which are conventionally recorded 
in the diagonal cells of a correlation matrix. The notation h) was adopted 
for the communality so that was the length of the test vector j in the 
pometrical representation of the common-factor space. The communality 
is, then, the square of the length of the test vector, and it is the scalar 
product of test j with itself. This interpretation of the diagonal makes it 
consistent with the side conelationa, so that the whole correlation matrix 
represents scalar products in the common-factor space. To estimate the 
communalities is, in fact, to make a cleavage between the common-factor 
variance a.nd the unique variance of the test battery. If this is done badly 
then the identification of the common factors and their relations is ob¬ 
scured in the resulting factor matrix. 

No matter what values are recorded in the diagonal cells, we have the 
theorem that th& numher of linearly independent factors represented by ike 
intercmelatians of n tests is equal to the rank of their correlational matrix Ri.t 
If unity IS written in the diagonal cells of a correlation matri.x, we call it the 
complete correlation matrix Ri," and its rank is usually equal to its order, 
namely n. If the communalities are written in the diagonal cells, we call it 
the reduced correlation matrix R," and the theorem then states that the 
nun^r of hnearly independent common factors in a battery of n testa is the 
rank of their reduced correlation matrix R. In making a factor analysis one 

usually gambles that the number of common factors is smaller than the 
number of tests, so that r < n. 


Since the diagonals are unknown, wo have the problem of determining 
e comraunahties so that they arc consistent with the rank of the side 
correlations, subject to the restriction that the communaUties must be posi- 

fcommunalities 
too high then we shall increase the rank of the correlation matrix which is 
due to the diagonals. Factoring such a matrix would force some of the 
unique variance into the factor matrix, which would give an incorrect re- 


* L. L. Thurstone, Theory of Multiple Factors (Chicago, 1933), p. 8 
t Ibid., p, 20. 


282 



THE UNKNOWN COMMUNALITIES 283 

suit. If we take the estimated communalities too low, then we destroy the 
Gramian properties of the matrix, so that it is no longer a correlation matrix. 

If we take the communalities at thdr correct values, then the rank of the 
side correlations is maintained by the communalities, subject to the restric¬ 
tion that they be positive numbers between 0 and +1. 

The relations between the experimentally given side correlations and the 
unknown communalities can also be stated in the theorem that the smallest 
number of independent factors that wiU account for the intercorrelations of n 
tests is the minimum rank of the corrdational matrix with the diagonal entries 
treated as unknown positive values between 0 and +1.* This theorem has been 
misinterpreted to mean that the rank is itself a variable, which can be given 
different values, and that the minimum rank should be chosen for which the 
communalities take possible values. The theorem is operationally true as 
far as computational procedures are concerned, but the essential fact about 
the communalities is that they are really determined by the side correla¬ 
tions, which are given. The problem is to determine the communalities 
which are implied by the given aide correlations. When found, they do give 
the minimum rank for which the communalities have possible values, t 

In dealing with experimentally determined correlation coefficients, it 
must be remembered that the sampling errors of the coefficients are fortui¬ 
tous and that, consequently, the rank of the correlation matrix with experi¬ 
mental values is, in general, equal to its order, namely, n. The scientific 
problem of analyzing a set of experimentally given correlation coefficients is, 
then, to find another correlation matrix of minimum rank whose discrepan¬ 
cies from the experimentally given coefficients are small enough to be ig¬ 
nored, We may summarize the multiple-factor problem as follows: From 
the experimental data we obtain the side correlations, and the diagonal cells 
are left blank. A matrix of minimum rank is to be obtained which deviates 
only slightly from the given side correlations. The diagonals are then filled 
in so as to be consistent with the side correlations. We then have the re¬ 
duced correlation matrix which is to be factored. In practice the compu¬ 
tational procedure does not follow this route, which is merely a statement 
of the theoretical problem. 

* lat ed., p. 73. 

t Professor Godfrey Thomson has discussed this aspect of the faetor problem as it the 
object wore to minimize the number of common faotors {The Faeloried Analysis of Hu¬ 
man AhilUy [Boston: Houghton Mifflin Co., 1930], chap. vLii). Operationally, ond as re¬ 
gards computational methods, it is correct to say that when the communalities have been 
written in the diagonal cells, the rank is a minimum. If the communalities were token 
smaller, the rank would rise. If the communalities were taken larger, then the rank of 
the matrix would also rise. This problem is resolved if we realize that the communalities 
a.re actually determined by the given side correlations, and it is merely a statistical prob¬ 
lem to find their numerical values or approximations to them. The theorem is correct 
in that the communalities maintain the rank of the side correlations, and this is the mini¬ 
mum possible rank. 
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High and low diagonal values 

Among students of factor analysis it is universal pracftif.e to leave the di¬ 
agonal elements as unknown when dealing with the case of unit rank. This 
is Spearman’s case of the central intellective fiu-tor. The tetrad difference 
equation is so written as to avoid the unknown diagonal elements, and 
Spearman’s single-factor formula is also written so os to avoid the unknown 
HiqgnTinlfl . When the single-factor saturations or loadings have been de¬ 
termined, the communalities become the squares of these loadings. The cor¬ 
relation matrix is, then, of unit rank, with all cell entries determined. Some 
students of the factor problem deviate from this logic as soon as they deal 
with higher ranks. Then they insert unity in each diagonal cell, regardless 
of the rank of the side correlations. This leads to an en’oneou.s factorial 
solution if the purpose is to analyze the factorial composition of the tests os 
given by the correlation coefficients. 

The question as to whether unity or the communalities are to be recorded 
in the diagonal cells is determined by the purpose of the factor analysis, If 
the purpose is to reproduce the original lest scores as closely ns pos.sibIe by 
means of any specified number of factors, then unity should be written in 
the diagonal calls. This is true even for Spearman’s hierarchy if the purpose 
is to reproduce the actual teat scores. If the purpose, of the factor analysis 
is to analyze the common factors that produced tlic intenjorrclations, then 
the communalities should be written in the diagonals. Tlie objective is then 
to reproduce the iniercorrelaiions as closely as possible. When unity is writ¬ 
ten in the diagonals, the original test scores can be reproduced with small 
residuals. When communalities are written in the diagonals, the intercorre¬ 
lations can be reproduced with small residuals, but the original test scores 
will leave larger residuals because the unique factor in each test is unac¬ 
counted for. The problem of analyzing the common factoi-s that are repre¬ 
sented by the intercorrelations is likely to be the more significant for scien¬ 
tific work, but there are legitimate problems that call for unity in the di¬ 
agonals. The two objectives—to account for the test scores and to account 
for the intercorrelations—emerge in the same correlation matrix when the 
communalities are unity. They differ even in this case, however, in the ref¬ 
erence frame that is chosen for final description of the variables. If the test 
scores are to be reproduced as accurately os possible with a small number 
of factors, the principal axes of the test conligurution is the indicated ref¬ 
erence frame. If the intercorrelations are to bo reproduced as accurately 
as possible with a small number of factors, then the reference frame is chosen 
by the principles of simple structure if it can be found in the configuration. 
If it is not found, then the reference axes may be placed according to clusters 
or in regions of the configuration which can be identified with any con¬ 
venient descriptive names, even though the axes so located do not repre¬ 
sent well-defined functional unities that are indicated when a simple struc- 
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ture can be discovered in the configuration.* The principal axes can also 
be used in this case if there is no intention to interpret the factors. 

In Table 1 we have a small numerical example that has been prepared to 
show the effect of taking communalities that are too ViigV^ or too low. In the 
first section we have a correlation matrix for three tests. Unity has been 


TahU 1 


1) d=l 

Correlation Matrix 



Factor Matrix 



1 

2 

3 


I 

11 

III 

1 

1.00 

- .48 

.56 

1 

.8384 

.2797 

-.4677 

2 

- .48 

1.00 

- .42 

2 

-.7809 

.6247 

.0000 

3 

.56 

- .42 

1.00 

3 

.8138 

.3449 

.4677 

2) d=W 
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1 

.64 

- .48 

.66 

1 

.80 



2 

- .48 

.36 

- ,42 

2 

-.60 



3 

.56 

- .42 

.40 

3 

.70 
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1 

2 
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I 

II 

III 

1 

.70 

- .48 

.66 

1 

.8009 

.1240 

-.2078 

2 

- .48 

.50 

- .42 

2 

-.6444 

.2911 

.0000 

3 

.56 

- .42 

.60 

3 

.7273 

.1671 

.2078 

4) d<W 


1 

2 

3 


I 

II 

III 

1 

.60 

- .48 

.56 

. 1 

.8031 

.10701 

-.18314 

2 

- .48 

.25 

- .42 

2 

-.6632 

.26911 

.0000 

3 

.56 

- .42 

.40 

3 

.6768 

.16211 

.18314 


written in the diagonal, and the corresponding centroid factor matrix is also 
shown. Since wo have here as many factors as there are tests, the test 
scores should be reproduced exactly, os well as the intercorrelations. In this 
case we have gained nothing by way of condensation or simplification, 
since the number of factors is equal to the number of tests. We might, then, 

* An example of a factorial analysis with a set of descriptive reference axes that are 
not primary factors is given in a paper by the writer, “A Multiple Factor Study of Vo¬ 
cational Interests," PereonnA Journal, X (1931), 198^205. The configuration was not 
analyzed for simple structure. 
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just as well use the original test scores as they stand, without any factor 
analysis. However, if it is desired to rcpre.sent the test scores with fewer 
factors than tests, the factor matrix here shown could be rotated to the prin¬ 
cipal axes, and the major principal axis could be used as the best single¬ 
factor representation of the scores. In that case the intereorrclations would 
not be well reproduced. 

In the second correlation matrix we have the same intercorrelations, but 
we have here the communalities that reduce the matrix to unit rank. The 
corresponding factor matrix shows one factor which reproduces the inter¬ 
correlations exactly. The test scores would not be well reproduced by this 
factor matrix. In fact, no single-column factor matrix can be written that 
would reproduce the test scores, since each test has a unique factor. 

In the third correlation matrix we have the same intcreorrelations, but 
here we have written diagonal values that are los.s than unity but greater 
than the communalities. The corresponding factor matrix is also shown, 
and it will be seen that here again it shows three factors. 

Finally, in the fourth correlation matrix we have the same intercorrela- 
tions, but we have written diagonal values that are less than the commu¬ 
nalities. Here the Graminn properties of the matrix have been destroyed. 
The principal minors are no longer positive or zero, and consequently this 
cannot be a correlation matrix. It can be factored by the centroid method, 
however, and the resulting factor matrix is shown. It is seen that the factor 
loadings contain imaginaries. 

The examples of Table 1 servo to illustrate the principle that the commu¬ 
nalities should be so chosen that they are consistent with the rank that is 
determined by the intercovrelatiun.s. When the diagonal elements exceed 
the communalities, the rank of the whole matrix Is, in general, ctjual to its 
order. The same result happens when the diagonal elements are lower than 
the communalities, in which case we have imaginaries in the factor matrix. 
The rank of the matrix does not seem to be in any sense a continuous func¬ 
tion of the communalities. On the contrary, the communalities are, in gen¬ 
eral, a singular set of diagonal values that are determined by the side corre¬ 
lations. In general, the rank of a coiTelation matrix is either n or r, but 
special cases could be constructed in which diagonal valvies could be chosen 
to make the rank take intermediate values between r and n. This could be 
done in fictitious examples by using the c()minunulitie.s in stJino of the diag¬ 
onal cells and higher values in the rest of the diagonal cells. It is evident 
that the diagonal values cannot be chosen so a.s to reduce the rank below 
that of the given side correlations. 

It should bo recalled that the unique variance of each test is determined 
entirely by the other tests with which it is associated in the test battery 
that is being analyzed. Except for the variable errors in the unreliability of 
a test, it can be associated with other tests that involve the same factors so 
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as to bring its communality up to the reliability of the test. This is, in fact, 
the challenge of factor analysis, namely, to formulate hypotheses about the 
nature of the factors that produce the intercorrelations and then to combine 
a test of unknown unique variance with other tests in such a mnnnar that 
the common-factor variance becomes completely known. In that case the 
communality is equal to the reliability of the test.* 

Minimum rank and minimum trace 

The trace of a correlation matrix is defined as the sum of the communali- 
ties, and it may be denoted t. Then 

( 1 ) 

i 

The problem has been raised by Godfrey Thomson as to whether the trace 
of a correlation matrix is a minimum when the diagonal elements have been 
so chosen as to minimize the rank. The question then is whether or not 
minimum rank and minimum trace coincide in the same set of diagonal 
values. The problem was investigated by Walter Ledei-mann,t who finds 
that, while the attainment of minimum rank by the choice of the proper set 
of diagonal elements gives a small value for the trace, this is not necessarily 
the minimum possible value for the trace for which the matrix remains 
Gramian. 

For the case of unit rank, the trace of the communalities is a minimum 

* In Btating his objections to the i;ae of communalities. Professor Kelley considers a 
hypothetical battery of ten testa, two of which involve a certain musical capacity not pres¬ 
ent in the other eight tests. The communalities of the music tests include their variance 
in the music factor, since it is common to two tests in the battery. Now, if one of the 
musical tests is dropped from the battery, the other musical test will have a reduced com¬ 
munality. The decrement is due to the music factor, which then becomes a specific fac¬ 
tor and is no longer a common factor. "Capacity in music reflected in part in the one 
test retained is now specificity, and according to Thurstone not worthy of retention in 
the analytical picture” (Truman L. Kelley, Essential Traits of Mental Life [Cambridge: 
Harvard University Press, 1935], p. 66). It is, of course, not a question of whether the 
specific musical ability is "worthy” of retention. The question ie how to disentangle the 
music factor from other specific factors in the same test and from the error variance in 
that test. The separation of the specific music factor from the other specific factors in 
the remaining musical test is not solved by writing unity in the diagonal cells. But the 
problem can be solved by using an augmented test battery, writing the communalities 
in the diagonal, and rotating the axes in. the common-factor space. Professor Kelley 
does not approve of this procedure, but he has not offered any other solution for the 
problem. 

t "On a Problem concerning Matrices with Variable Diagonal Elements,” Prooeedmg 
of the Royal Society of Edinburgh, LX, Part I (1939-40), 1-17. 
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except when one of the loadings is larger than the sum of the others. If we 
let hi be the largest saturation, we have, for the exceptional case. 


n 

( 2 ) hi>'^hi. 

y=2 

The exceptional case is obtained by taking another set of value.s uj so that 
the new diagonal values become 

(3) di = III 4- uj. 

A unique set of values of Uj is obtained from the relations 

W '^i — hiQii — Ija — /ia — • ■ - —j 

(5) Us = hj{hi - h-hi -/i„), (y = 2, 3, . . . , n). 

The trace for the new diagonal values ds is then smaller than the trace for 
the unit rank diagonals Kf by an increment c, which is 

(6) e= '^us= -Oh - Ih - hi - ■ -h„)", 


but the rank of the matrix with diagonals dy is (n — 1), The matrix is still 
Graraian. 

Tabic 3 

Correlation Matrix Factor Matrix 



In Table S we have a numerical example. The correlation matrix of order 
5X5 IS of unit rank when the communalities h] are used. The correspond¬ 
ing single-column factor matrix is also shown in the table. The trace for 
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hj is .9460, and the rank is 1. The corrections uj were computed by (4) and 
(5), producing the new diagonals dj as shown. The new trace is lower, name¬ 
ly, .9050, and the decrement is (.20)“ = .04 by equation (6) with rank 
(n “ 1). The same authoi investigated the minimum trace for higher ranks 
with the same conclusion, namely, that the minimum trace for which the 
matrix remains positive-definite is not necessarily that which gives mini¬ 
mum rank. 

On the basis of these findings we can write the useful theorems that the 
communalilies are a set of diagonal values which retain the rank determined by 
the side correlations. The communalities give the matrix its minimum rank, 
namely, the rank of the side correlations. The minimum trace does not neces¬ 
sarily give the minimum rank even when the diagonals are so chosen that the 
matrix remains Gramian. In practice, it may be expected that the matrix 
will no longer bo positive-definite when the diagonals are chosen lower than 
the communalities. 

The He3nvood case 

A special correlation matrix that has attracted the attention of some stu¬ 
dents of factor analysis is that in which the rank is 1 (Spearman’s hierarchy) 
but in which one of the diagonal elements must be greater than unity in 
order to preserve the low rank. A correlation matrix of rank 1 in which a 
diagonal entry exceeds unity is called a "Heywood case."* This curious 
type of matrix will be discussed here with the example used by Godfrey 
Thomson in his analysis of this intei’csting case.t 

The correlation matrix of Table S is of order 5X5, and it is of rank 1, as 
far as this can be determined by the proportionality of the columns of side 
correlations. If we determine the single-factor loadings that will produce 
the correlations, we have the single-column factor matrix as shown in the 
table. Since one of these loadings is greater than unity, we have here a Hey¬ 
wood case. Instead of worrying about this circumstance as if it were some 
insuperable obstacle in factor analysis, it would seem better to regard this 
finding as showing merely that the first test does not conform to unit rank, 
which has been imposed on this correlation matrix. If we confine our atten¬ 
tion to the other four tests, we have a clear case of unit rank, but not when 
all five of the tests are considered together. 

In the same table we have exhibited one of an infinite number of con¬ 
sistent factor matrices that could be written to cover this case. We have 
here a common factor, as shown, with a unique variance for each test. 
These are arbitrarily written so that the total variance is unity for each of 
the four tests 2-5, but consistent factor matrices could be written for this 

* H. B. Heywood, "On Finite Sequences of Real Numbers,” Proceedings of the Rogal 
Society, A, CXXXIV (1931), 486-601. 

t Op. oil., p. 231. 
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case in many other ways. Test 1 is shown here tu; a coinple.\ test If ’ 
consistent five-column factor matrix is miilti])lied Ijy its transioso th 
by the fundamental factor theorem, FF' = R, the given correlation matri! 
IS reproduced. The communahty of tc.st 1 Ls now .9802, which is less tha 
unity, and the my.stery of the Ileywood case Iims been lusolved It could 
have been done in many other ways that imply more than one factor in 
the complexity of the offending to.st 1. It is advisable to restate here the con 
dition under which a correlation matrix can be accounted for by a single com" 
mon factor. A correlation matrix can be described by a single common factor if 

^tl^ofumtrank(proportionalcolimns)andifthedinoonalsarepositive7iumb^^^ 

between 0 and +1. If these conditions are not .sati.sfied, then more than one 

Table S 

Correlation Matrix 



1 

2 

3 

4 

5 
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.945 

.840 

.7.35 

.6.30 

2 

.945 


.720 

.630 

.540 

3 

.840 

.720 


..5(i0 
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.030 

..560 


.420 

5 
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.540 

.480 

.420 
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.80 
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.70 
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II 


III 
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.90 

.90 

.80 

.70 
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.3097 

.4350 


.2000 

.0000 


.1470 .112.5 


.7141 


.8<H)0 


.0802 

1.0000 

1.0000 

l.(KK)0 

1,0000 


required to dascribe the correlations. Mathematically, a 
cJ^hi d Preporti»nal columns and positive diagonals 

but the^nro?^ the product of a single-column matrix and its transpose, 

negative or if they exceed unity. 

is sSilitf+I,nfanahigous Ileywood ca.sc.s in multiple-factor analysis 

nncp nf i multiple fmdors tlic appear- 

the factortnf""'- ? T that the raiik of 

the factoi matrix is liigher than that wliich produced the Ileywood case.* 

alar^ni^beJ'of^ta wi'th thp analysis of Spearman’s hierarchy for 

When the number of teatj.! n, “ Hey wood case would necessarily arise. 

correlalSn ZtS vlTst determinant cf the 

cannot vZisTSZ^ I determinant of a hierarchy 

onnot vanish with unity m the diagonals except by introducing a Heywood oase.i.e., a 
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The number of independent factors 

In the analysis of experimental data in relation to some hypothesisi one 
always considers, either explicitly or implicitly, whether or not the experi¬ 
mental observations are adequate to sustain the hypothesis. Attention usu¬ 
ally centers on the discrepancies between the fallible experimental observa¬ 
tions and the proposed theoretical relations. This is the principal domain 
of statistical method. But even before such analysis can be undertaken, one 
must satisfy an even more fundamental requirement. The number of ex¬ 
perimentally independent observations or readings must exceed the num¬ 
ber of independent parameters in the hypothesis in order for the demonstra¬ 
tion to be determinate and convincing. This principle is universal, and it is 
so fundamental that every scientist takes it for granted intuitively even 
when he does not formulate it explicitly. 

We shall consider a simple example of the principle. Suppose that the hy¬ 
pothesis states that two variables are proportional. Writing this hypothesis 
explicitly, wo have y = kx for all observations. There is only one parameter 
in this hypothesis of proportionality. The hypothesis would be represented 
by a straight line through the origin, and all observations should lie on that 
line. Suppose that we take only one observation, which consists of an ob¬ 
served numerical value for x and the associated numerical value for y. 
Plotting the observation on cross-section paper, we have only one point. 
No one would accept such a demonstration, because one point on the graph 
does not demonstrate that the two variables are proportional for all pos¬ 
sible values of x and corresponding values of y. The hypothesis involves 
only one parameter, and we have only one observation. We must have 
more observations than there are independent parameters to be determined. 
Two observations which fall on a line through the origin would look prom¬ 
ising, but they would not be convincing. Five or six observations or twenty 
or thirty would be convincing. We demand intuitively in any scientific 
demonstration that the number of experimental observations exceed the 
number of independent parameters in the hypothesis that is to be sustained. 
This is, in one sense, the opposite of the mathematical requirement in solv¬ 
ing simultaneous equations. If we have more simultaneous equations than 
unknowns, we are afraid of inconsistencies. In scientific work the parame¬ 
ters must be many times overdetermined, with small experimental incon¬ 
sistencies, before we accept a hypothesis as plausible. 

dinigonal elomcnt greater than unity. Wo have the theorem that if a correlation matrix 
with unity in the diagonals is of unit rank, then all side correlations are either 4-1 or — 1. 
The determinant then vanishes exactly as is to be expected. Then all the tests are per¬ 
fect measures of the single common factor, and there is no Heywood case. If the side 
correlations are less than unity and if unity is recorded in the diagonal cells, then the de¬ 
terminant still vanishes when n = N, but the rank is then higher than 1 and there is 
no Heywood cose. 
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In a large and more pomplex problem one niiEht foriret . 

the attempt to determine more parameter than tlier/are ® 

.independent observations. In fartnr analy.«i,s it is n.sefnl to know 
independent factors can be determined from any expcrinicm ' 
relation matrix. In order to find tliLs relation W(* con-^idcr the m T 
experimentally independent correlation i-ocfficicnts for a butter 
and the number of linearly independent facf<m 

for n teats and r factors. i'>.itnng,s ni a factor matrix 

The number of intercorrelations in the correlation nmtri.v of Table 4 b 

n(n — 1) 

2 

since we regard the diagonal elements as unknown. In considprino tl 
ber of hnearly independent cell cntrie.H in the fmdor matri.s^ wfmtS 
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In order that there may be a unique configuration of test vectors for the 
correlation matrix, the number of experimentally independent correlation 
coefficients in li must equal or exceed the number of linearly independent 
parameters in F. Hence 


(7) 


nr 


r(r — 1) ^ n(n - 1) 
2 = 2 


The condition for a maximum value of r for a given value of n is represented 
by substituting an equality sign for the inequality. The condition then 
becomes 

( 8 ) 

2 2 
or 

(9) 2nr - r(?- — 1) - n(n - 1) = 0. 

Solving the quadratic in r, we have the following theorem: In order that 
the correlational matrix K with unknown diagonals for n tests and r common 
factors shall represent a unique configuration, it is necessary that* 


( 10 ) 


.. ^ (2n + 1) - V&TTT 

r ^ A 


The suppression of the positive sign before the radical in (10) is justified by 
the postulate that r < n. When the equality sign is used in (10), the value 
of r becomes integral for certain values of n. Then the number of independ¬ 
ent parameters of F is exactly equal to the number of experimentally inde¬ 
pendent coefficients in R. Such is the case when n=Q and r=3. We see 
also, for example, that at least three tests are required to determine one 
common factor and that at least four tests are required in order that 
one common factor shall be overdetermined. This is the situation in Spear¬ 
man’s tetrad difference equation, which involves four tests for the deter¬ 
mination of a single common factor. At least five tests are required to de¬ 
termine two common factora. 

Since equation (9) is symmetric in n and r, n can be expressed explicitly 
in teims of r by analogy from (10), so that 

(11) „ a (ar +1) + VsF +j 

a 


This relation shows the minimum number of tests required for the determi¬ 
nation of r factors. Equation (11) shows, for example, that there must be 
at least eight tests in order to deteimine four common factors. 

* Ist ed., p. 76; see also E. B. Wilson, "Beviaw of Croasroads in iAs Mind cf Man [by 
T. L. Kelley],'' Journal of Qeneral Psyc^logy, II (1629), 168. 
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An actual count of the correlation coefficients in Table 4 sliows 28 wher - 
as the count of independent parameter in tiie factor matrix is 30.' Henc' 
the five indicated factors cannot be determined from tlie correlations of eight 
tests. Four factors can be deteimined, .since 28 > 20; but this calculation 
assumes that the correlation coefficients are infallible. With actual data one 
would not ordinarily attempt to find more than two or, at most three fnr* 
tors for eight tests. 

It is useful to have a table to show the smallest number of tests that will 
just detemine a given number of factors or the largest number of factors 
that can be determined by a given number of te.sts. This information is 
summarized for ten factom in Table 5. This table must not be used to de 
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No. of 

No. <jI 

No. of 

raclora 
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TchIb 
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(> 
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2 

r> 
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G* 
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0 
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10 
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etoTs is ™r fusts, as far as the count of independent param- 

«“ “'6'" ov'nleterJnation 
rf Mibl. Sita «coeptance oj a factorial interpretation 

Methods of estimating the co mmon alities 

ma^e^thp^cn numerical work of factoring is begun, it is noce.ssary to esti- 
sidprpH ® The astimation of (;ommunalitie,s will be coii- 

commil (1) when exact, or nearly exact, 

meTin tidiZ r'n ’ 

when fnp+n • ® f‘''Utor lias been e.\traetcd; and (3) 

that avoids +ZZ , The third case implies any factoring method 

of residuals after each factor has been com- 
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The first ease is that in which it is desired to estimate the communalities 
very closely. For large correlation matrices it is seldom necessary to insist 
on close estimates of the-communalities. The reason is that in this case the 
factorial results are not seriously affected by coarse initial estimates for the 
diagonal cells. It is another matter when the correlation matrix is small, 
say, of order 8 or 10 or less. For small correlation matrices the factorial re¬ 
sults can be markedly affected by wrong estimates for the communalities. 

The best procedure for small correlation matrices is probably to do the 
factoring with such estimates as can be made. The resulting factor matrix 
will then give a new set of communalities, which can be reinserted in the 
original correlation matrix. The factoring can then be repeated with the 
new communality estimates. But in the subsequent trials one 'does not 
make any adjustment in the diagonal cells after each factor. After a few 
trials it will be found that the communalities determined by the factor 
matrix are practically the same as those with which the factoring was 
started. These values may then be accepted as close estimates of the com- 
munalities. It is a fortunate circumstance that the necessity for repeating 
the factoring in order to get stable factorial results and stable communali¬ 
ties occurs with only small correlation matrices for which the computational 
labor is not prohibitive. For large correlation matrices this repetition of the 
factoring is seldom if ever necessary. 

In dealing with experimental data it must be recalled that the rank of the 
correlation matrix is, in general, equal to its order. It is then a question of 
statistical judgment when the residuals are small enough so that they can be 
ignored. If the factoring is continued without adjustment in the diagonal 
cells after each factor has been determined, the residuals will be identically 
zero after n factor’s have been extracted. This is true for the yarious cen¬ 
troid methods and for other methods of factoring. In practice the com¬ 
puter stops the process before such a result has been obtained. He stops 
extracting further factors when he judges the residuals to be sufficiently 
small. At this stage it is evident that each additional factor contributes 
very little to the total variance of each test in the common factors. Since 
each factor contributes a small increment to the communality, it is evident 
that the estimated communality must bo judged in relation to the number 
of factors that are extracted. It follows also that the true communalities 
can be determined only by extracting (n— 1) factors with n tests in the 
battery. It would usually be a waste of time to carry the work to this 
extreme, and con.scquently the true communalities are not ordinarily de¬ 
termined for experimental data. In determining the best-fitting communali¬ 
ties by repeating the factoring several times, we must remember that each 
trial should be taken to the same number of factors. The revised estimate 
of the communalities should then be stated for the number of factors that 
were detemined. When it is desirable to obtain a very close estimate of 
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the communalities for a specified number of factors, the ideal procedure ' 
to obtain the principal-axes solution to the specified number of factors and to 
repeat this process with adjusted communalities, as determined in each trial” 

Our second case is that in whioli a factoring method is used which gives a 
set of residuals after each factor. There is then an opportunity after each 
factor to adjust the diagonal cells. The simplest method i.s that of recordinir 
in the diagonals the highest coefficient in the column. This method has 
been used in a large number of studios with satisfactory results. 

Our third case is that in which the diagonals are not adjusted after each 
factor. This is necessarily also the case when the factoring is done with 
out computing residuals after each factor. In this case it is necessary to" 
make a fairly good estimate of the communalities before the factoring is 
begun. If in this method of factoring it should bo discovered that a large 
error has been made in estimating the diagonals, it might be neee.ssary to 
repeat the factoring in order to correct the error. This will be true esne- 
oiaJly for small correlation matrices. ^ ' 

A number of principles and computing formulae will be con.sidered by 
which the communalities may be estimated. Most of these formulae are 
approximate. 


1. Expansion of a minor of order (r-|-l) 

If the correlation coefficients are infiUliblo and if the rank of the correla¬ 
tion matrix is assumed to be r, then the commimalitie.s tsan be computed on 
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ables. The rank of the matrix ia 2. Table 7 shows a minor of order 3 with one 
unknown entry, namely, the communality for variable number 1. In order 
that the expansion of the minor may vanish, the unknown diagonal entry 
must be .64. If the rank is assumed too high, say 3, it will be found that the 
coefficients of hi, as well as the numerical terms, all vanish. This indetermi- 
uacy can be removed by assuming a lower rank. The fact that the minor of 
Table 7 vanishes does not demonstrate, of course, that the correlation matrix 
is of rank 2. Instead of evaluating all the minors of order 3, one might pro¬ 
ceed to factor the matrix after all the communalities have been determined 
by this method, and it would then be found in the factoring routine whether 


Tabu 7 
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1 

Af 

.56 

.18 

4 

.24 

.49 

.48 

5 

.72 

.87 

.24 


the assumed rank was correct. It is evident that this simple method is not 
stable when used on fallible data. 

2. Grouping of similar tests 

If a test battery ia large and if it contains constellations or clusters of 
similar teats, then the tests in each constellation will be represented by vec¬ 
tors in the common-factor space with relatively small angular separations. 
T(ie communality of a test is the square of the length of its vector. If the 
angular separations between several test vectors are relatively small, then 
the projection of a test vector on the centroid vector of the constellation 
will be nearly the same as the length of the vector. The square of the pro¬ 
jection may be used as an estimate of the communality of the test. The 
estimate will usually be slightly too low. The projection of each test vector 
on the best-fitting single vector for the constellation can be regarded as an 
approximation to the loading of the test with the single common factor 
which best describes the intercorrelations of the tests in the constellation. 

Let the communality to be estimated be denoted fc? and lot the tests which 
correlate highest with number 1 be denoted 2, 3, . . ., s, so that there are a 
tests in the group. The intercorrelations of the tests in this group may be 
assembled in the accompanying tabular arrangement, which ia particular- 
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ized for s=4. It is desired to estimate tl)e cominmiality hi from the proiee 
tion of test 1 on the centroid axis for this subgroup of test vectors. A slieht 
underestimation may be expected, because tiio lengtli of the first test vectoi- 
will be .slightly longer than its projection on tho centroid axis for the groun 
unless they should happen to coincide. To compensate for tills underestima’ 
tion we may underestimate the comniunalities of tlie adjacent te.sts 234 ' 
by writing in the three adjacent diagonals the average of eacdi column ’ The 
sum of the adjacent columns 2, 3, , s, may then be written 

■s(Sr - Si-i) 

(s - 1 ) ' 

where 2 r denotes the sum of all known coefficients in the table and Sr, de¬ 
notes the sum of all known coeflicionts in the first column. 

The sum of all the coefficients in tho table can then be e.stimated as 


(2r, -I- M) -1- 


s(Sr - Sr,) 
is - 1 ) 


and the complete sum for the first column i.s 


The projection of the first teat ve(!tor on the centroid axis is tho ratio of the 

coefficients in the 

Lt - “'‘"“''I have, 

hi == (Sri + hi y 


2 r. -t- hi + - f’'' } ' 


which simplifies to 
( 12 ) 


(s - 1 ) 


1 , 2 .^ (■■» ~ l)( 2 ri)^ 

■ *'Sr - (2s - i)2r, 


tion it“m^\p oqmvalent forms. In computa- 

known coiffici^nT^ «'»««. namely, the sum of tho 

contTr.!ffi ! • f the known adja- 

These are mTrk which arc not in the first column or row. 

Uiersum ^gemeiit. Let 

Substitutinir thi 2(2ri-|-Sro). 

Substituting this expression for 2r in (12), we have the equivalent formula 


(12o) 


— l)( 2 ri)^ 
2ri -|- 2s2ro ’ 
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where Sri is the sum of the known ooefBcients in the first column and Sj-q is 
the sum of the adjacent coefficients in the half-table which are marked in 
parentheses in the tabular arrangement. These formulae will be referred 
to as “centroid formulae.” 

For convenience we may list the equivalent formula for small subgroups 
of related te.sts. When the group contains 3 tests, we have for a=3, 

(12t) 2:r, -f- Was (3-te3t formula). 

When s = 4, we have 

(12c) hi == (4-test formula). 

It is interesting to note that for a doublet when s = 2 this formula reduces 
to hl = hl = rii. A doublet is factorially indeterminate, but it will be seen 
that, when the coefficients for a doublet in a large battery do not entirely 
vanish, a graphical method may be applicable. 

3. Grouping of three tests 

A special case of the grouping of similar tests is that of using only three 
tests that are highly correlated in a constellation or cluster. One procedure 
for estimating the cominunality of a test j is to select the two tests, k and I, 
which have the highest correlations withj. If a test battery is so construct¬ 
ed that each postulated ability is represented by several tests, it can be ex¬ 
pected that the three tests, j, k, and I, will be represented by test vectors 
with relatively small angular separations. The communality of test j can be 
estimated by one of Spearman’s formulae, namely, 


(13) 



which is equation (15) of chapter xii. It is here written as an approximation 
formula beciause the communality of test j in a test battery is not necessarily 
determined by only three tests. This would be a simple method of estimat¬ 
ing tlio communalitios in practical work except for the fact that it is un- 
.stable because of sampling errors. It can be used as one estimate of the 
communality if it is combined with other more stable estimates. It will be 
referred to as a “3-test formula." 

4. Highest coefficient in each, column 
Inspection of equation (13) for estimating the communality of a test sug¬ 
gests a further simplification in the estimate. The numerator contains the 
product of the two highest correlations in the column for test j. The de- 
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nominator is the internorrelatioii of tlic two tests so selected n.,, i 
k and . If these coefficients are of the same order of magnitude’ then 
estimated commiinality of test; will be nearly equal to the highesJTntl® 
correlation m column j. This is the method that has been used in 1 w 
munber of studies in which the factoring was done by one of the no f 
methods, adjusting the diagonal values of the residuals after each fa^f 
had been computed. This simple method of estimating t. 
usef^ul only for large correlation matrices. It is not applicable f M 

The principles of No. 3 and No. 4 can be combSn 
ormu a. Let test 1 be the test whose communality i.s to brestimafeS 
et t^ts J 3, and 4 be several other tests which have high corSw’ 
test 1. The coefficients mav be shown in tim --- 
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(14) 

so that 

(15) 


-bfi 


^ (I'J'i + <i)* 

' • ^r + Zt ' 


.68 as an estimated comm^iLBy^Sfe*^""*^!^ (2.64)711.10, which gives 
tion (14) is a centroid formula. ^ 

6. Linear dependence of rows and columns 

linearly in terms of any be expressed 

this principle into a method^nf^ entrows. It may be possible to generalize 
P into a method of computing the communalities for fallible 
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data. In using this method one assumes a rank for the correlation matrix, 
and it is also essential that the rows chosen for the computation he linearly 
independent. 

The idea of using linear dependence of rows and columns of the correla¬ 
tion matrix could perhaps be used for estimating the communalities if the 
matrix were divided into four or into nine sections. The method can be out¬ 
lined with the adjoining table showing a correlation matrix divided into nine 


fill 

i2u 

Rii 

■Rii 


Rtt 

flji 

Ra 

Rit 


square sections. Let us assume that the tests have been divided into clus¬ 
ters by inspection of the correlations. Each cluster should be represented 
by at least one test in eacih of the three groups into which the tests have 
been divided. The notation in the table means that Ra, for example, is 
the square section showing the correlations of the tests in the second group 
with the test.s in the third section. With this prearrangement of the teats 
in three groups and with the assumption that the rank does not exceed 
one-third of the number of tests, it should follow that the third group of 
columns can be represented by a linear transformation of the second group 
of columns, and similarly for the rows. If T denotes a linear transformation, 
we should write RnT = Rn, RiiT — R^z, RtiT — Rn. Since the sections Ri\ 
and Eji are known, the transformation T could be determined and hence 
the other sections. Tho side correlations of the symmetric sections so com¬ 
puted should not deviate far from the experimentally given values in the 
three diagonal sections, and the communalities would then be estimated. 
This idea has not been developed into a practical computing method for the 
communalities, but it might be done.* 

6 . Sectioning of the matrix 

The unknown communalities can be solved for by sectioning the correla¬ 
tion matrix. This method has not been used because it requires more com¬ 
putation than the simpler methods that have been found adequate in prac¬ 
tice, and it is not a stable method for fallible data. The sectioning theorem 
will bo given hero be(:aus(5 of its interest in relation to the correlation matrix. 
If any mairix of ratik r is sectioned into a composite square matrix of order s, 
where 8>r, the7i the determinant of the composite mairix vanishes. 

The matrix will bo said to be sectioned when the columns have been di¬ 
vided into 8 groups, and when the rows have also been divided into the same 

* Since thia chapter was written the idea has been developed into a computing for¬ 
mula, as described in a later section of this chapter on "Further Studies of Linear De¬ 
pendence." 
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umber of groups. Let r =2 as an example. Since s>r, we may let 
Then the a columns of R will be divided into three groups of p fc-lV 
(n-?) columns, respectively; while the n rows of ^W 1 I be d Led 

srsVi<“-"' ““ 

The composite matrix will be defined osi, the square matrix of nrdp. ■ 
which the entries are the sums of the elements in the corresponding ' r 
to Th. example et ™„. H iltatmte 
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rp — niirii -|- niji'j, ^ 
Tie = TOirij -(- OTjj-jj ^ 


r,* = min* -j- Mjrjit. 
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It is evident that the sura of the first p entries of row j can alan be expressed 
as the same linear function of the corresponding sums in the first two rows. 
We then have 



Similar summations may be written for the other two groups of columns so 
that 


(18) 
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X Tik + m2 ^ rat , 




fc=(p-H) 


fc=(p+i) 


'y f '''ik = ^ ’’l* + m2 ^ 7 « . 


U-“(4+l) 




fc=(a+i) 


These summations may be represented in an nX3 matrix as shown in 
Table 10, Since each of the rows can bo expressed as a linear function of the 
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first two rows, it follows that the rank of this nX3 matrix is also 2. The col¬ 
umns may be so arranged that the third column of this matrix may be ex¬ 
pressed in terras of the first two columns. This reduction by columns is 
similar to the reduction by rows that has been described. This reduction 
by columns gives a 3X3 composite matrix whose rank is 2, and hence its de¬ 
terminant vanishes. If the rank of E is equal to or greater than the order s 
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of the square composite matrix, then the determinant of the composite does 
not necessarily vanish. 

The communalities can be solved for by .sectioning, if thi.s is done in such 
a manner that one row and the corresponding column are taken jis sections 
Their intersection will be a section with a .single entry, namely, the commu- 
nality to be determined. 

7. Expansion of principal minora of order (n —1) 

It is possible to write n principal minors of order (71—1) in a square 
matrix of order n. If the expansion of each of tho.se Ji principal minors of 
order (n- 1 ) is set equal to zero, the rank of the matrix is iissumed to be not 
greater than (n- 2 ). This follows from the property of a Gramian matrix 
that if all of its principal minors of order vt vanish, then the rank of the 
matrix does not exceed (wi— 1 ). Since there arc n principal minors of order 
(n- 1 ), their expansions give as many equations as there are unknown diag¬ 
onal entries. A unique solution is obtained if the inequality (10) is satisfied. 
If this inequality is not satisfied, there should be no unique solution. In this 
method it is not necessary to know the rank. These considerations are of 
some analytical interest, but they do not seem to lend therruselvcs to com¬ 
puting purposes. 

8 . Expansion of principal minors of order (r-|-a) 

This should be a special case of the preceding method but leas laborious. 
It IS not necessary that the rank be known, but it is assumed that (r-f-a) is 
taken larger than the rank. The simplest case is that in which a=l. This 
method requires that the number of tests covered by the c.xpanded principal 
minors be such as to satisfy inequality ( 10 ), even though all the tests in the 
correlational matrix are not utilized. The development of this type of anal¬ 
ysis would be of interest, but so far it has not led to practical computing 


9 . A summation formula 

Let the test whose communality is to be determined be denoted number 
, and let n^ber 2 be the test which correlates highest with te.st 1 . These 
wo es 8 w 1 usually have a small angular separation, and hence their in- 
tercorrelations should be nearly proportional. Hence 


(19) 


- rig ^ ^ 

2!rj - m • r,s' 


where Sri and Srj are the sums of the known coefficients in the two columns. 
iPis gives the approximate computing formula 


j,a i ^^(Sri — rij) 


( 20 ) 
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which may be referred to as a "summation formula.” Its source of insta¬ 
bility is the single coefficient rij, whose variable error influences directly the 
estimate of hi. This formula makes the assumption that the two columns 1 
and 2 are of unit rank and hence that they are proportional. 

10. Spearman’s formula 

The summation formula of eciuation (20) can be generalized for a group 
of four correlated tests, including test 1, which may be assumed to be nearly 
collinear. From (20) we may write for each of the three testa 2, 3, 4, 

/ni \ 1,2 _ ~ ^' 12 ) _ riafSri — r^) _ ri4(2ri — riO 

'■ ^ ‘ (Sra - ria) (Srj - m) (Sr* - ru) ' 


where Sr* is the sum of the known coefficients in column x. From these 
three expressions we write 


( 22 ) 


,» _ rialSri - r^) 4- ruCLri - ru) + - ru) 

'■ (Sn - ri«) -I- (Srs - rjs) -|- (Sr^ - ru) ’ 


which simplifie.s to one of Spearman’s formulae for the single common fac¬ 
tor, namely, 


(23) 


.. ^ (Sri)^ - (arp 

^ ‘ 2r - 2Sri ' 


which is the same as eeiuation (51) in chapter xii in different notation. 
Here Sr is the sum of all known coefficients for the subgroup and Sr? is the 
sum of the squares of the coefficients in the first column. This formula of 
Spearman should give a good estimate of the communality, although it was 
not originally written in the present context. The formula assumes ap¬ 
proximation to unit rank for the subgroups. 

11. Grouping of four tests 

Spearman’s 3-tcst formula, equation (13), can be adapted to the case of 
four correlated tests where te.st 1 is the one whose communality is to be 
estimated. In the 3-tcat form we have 


(24) hi = , 

raa 

and this can be extended to four tests in the relations 


hi 


ruTii riarn ^ rnri4 

r '23 * rai r24 


(25) 
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These three formulae can be combined into a single 4-test formula by tak¬ 
ing the geometric mean of the three expressions, aiul we then have 


(26) 


* * V **23*'24*’m 


12. Graphical methods of estiination 

If two teat vectors (1 and 2) arc nearly collinear, the ('orrelalions (if their 
respective columns should bo proportional t<i the ratio of h,/hn. We should 
then have 

rjj ^ Ita/tj- cos ij)gj _ 
rij h\hj cos 4>ii' 


and, since the two cosines should be nearly the same, we have 


(28) 


rij 


h 

hi 


or 

(29) Tij = Vii = .Ssiri,. 


Hence there should be a linear plot of against ri/ through the origin. 
Since the correlation ru should be nearly equal to hihs, wo .sliould have, ap¬ 
proximately, 

(30) /i! = - and M r,«.s..i, 


by which the communalities can be estimated. When the plot is clearly 
linear through the origin, this method of estimation is good except for the 
variable error in ru. A clear linear plot indicates that the two test vectors 
are nearly collinear. This method of estimation is proV)ably the best 
one in dealing with a doublet, in which lauio there is only tine appreciable 
coefficient in the column. 

If two tests, 2 and 3, arc <!oplanar with test 1, a computing formula can 
be written for estimating the corainunalities by plotting against rj,-. 
The plot should then be linear but not ordinarily t hrough the origin. From 
the slope and one of the intercepts one could then determine the linear com¬ 
bination of columns 2 and 3, which reproduces column 1. Thi.s eoplanar 
method is of some interest, but it is not, in this form, readily applicable. 
The collinear form of graphic estimation is often quite useful. 
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Summary of methods 

When a column of the correlation matrix contains a number of coeffi¬ 
cients that are quite high, the estimate can be made with one of the formulae 
which include the correlations (jf several tests. In general, we should expect 
instability with fallible data when the error in the estimate is directly af¬ 
fected by tho error in a single coefficient as in equations (13), (20), and 
(30). 

When a column ctmtain.s only one high coefficient, none of the computing 
formulae apply because we then have essentially a doublet. The estimate 
might then be made by the graphical method. A pure doublet in which 
there is only one non-vanishing coefficient in the column, while all the rest 
are zeros, is fac.toriully indeterminate. Theoretically, this case is the same 
as that of a correlation matrix for only two variables. There is only one 
correlation which Ls insufficient to detemiine two communalities. In prac¬ 
tical work one seldom find.s a pure doublet, but one does find approximations 
to them. If a doublet is to be retained in a battery, one can sometimes make 
a good estimate graphically if the remaining coefficients do not entirely 
vanish. Another procedure is to set lK)th communalities equal, in which case 
they arc both cqiial to their eorrelation, the highest in the column. 

If the factoring i.s to bo done by a method with adjustment in the diag¬ 
onals after each factor and if the battery is large, say, more than twenty or 
thirty variables, then one may record the highest coefficient of the residual 
column in each diagonal coll. This procedure is not adequate for small cor¬ 
relation matrices. For vciy small tables of, say, less than ten variables, one 
may need to repeat the factoring several times to obtain good estimates of 
the communalities and an acceptable factor matrix. 

Uniqueness of communalities 

We have con.sidcrcd the problem of ascertaining whether there are enough 
independent correlation coefficients in R to detennine the factor matrix for 
r factors. This problem is solved by the relations of the inequality (10), 
which give,s the maximum number of common factors that can be deter¬ 
mined from the intcrcorrelations of n tests. In the theorem for the inequal¬ 
ity we stated that for any given number of common factors (r) to be deter¬ 
mined by a given number of tests (n) it is necessary that the inequality be 
satisfied. The theorem does not state that the satisfying of the inequality 
(10) is suj/l-cient to iiisure tliat r factors can bo determined from the inter- 
correlations of n tests. In deiiving the inequality we merely counted the 
number of independent parainetcrs in the correlation matrix and the num¬ 
ber of independent parameters in the desired factor matrix. The relation 
between these two counts does not insure that the diagonal values will be 
positive numbers between 0 and -f-l, and it does not take into consideration 
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the possibility of multiple solutions with real or imaginaiy diagonal entries 

in the correlation matrix. , i,. j -j. 

If a correlation matrix is factored by the diagonal method with unit coin- 
munalities {chapter ii), a factor matrix can be obtained which accounts for 
the intereoiTelations exactly with not more than n factors. If n factors are 
required to account for the intercorrelations, then the last column of the 
factor matrix contains only one entry. Hence it may be regarded as a spe¬ 
cific factor for the last test. We therefore have the theorem that there ex¬ 
ists at least one set of communalities between 0 and +1 for which the rank of 
the reduced correlation matrix is less than the number of tests. Every correlation 
matrix can be accounted for by not more than (n—I) common factors. 

In making an exact solution for the communalities, one would take a 
trial rank r and then expand minors of order (r-fl) which should vanish. 



These minors should be so selected that they contain a minimum number of 
diagonal cells. In Figure 1 we have represented the correlation matrix and 
the principal diagonal. Let ABCD be a minor which is so placed that it 
contains a minimum number of diagonal cells. Tjct the number of columns 
which do not contain any part of the minor bo denoted b. The number of 
columns b then is 

— r — 1, 

and hence the number of diagonal cells outside the indicated minor is 

2{n — r — 1) ; 

so that the Tninimum number of communalities M that can be placed in the 
minor is 


(31) 


M = n — 2{n — r — 1) 
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or 

(32) if = 2r - 71 + 2 . 

When if <0, a number of minors of order (r+1) can be taken which contain 
a particular communality and no others. If if <1, then a minor can be so 
placed that it will contain only one communality. By expanding such a 
minor and setting it equal to zero, we have a linear equation with one un¬ 
known, namely, the desired communality, which can then be numerically 
determined. We then have 

(33) r < for if < 1. 

The number of factors is then less than half of the number of tests. When this 
condition obtains, there is a single analytic solution from the selected 
minor. If the communality so determined should exceed unity, then the 
rank of the correlation matrix must be assumed to be higher than r and a 
higher trial value for the rank must be taken. When r is taken so that 
i/<0, the consistency of the several possible determinations of the com- 
munalities must be examined. 

Multiple solutions for the communalities are of special interest, and they 
may arise when r is taken so large that the minor ABCD in Figure 1 con¬ 
tains two or more communalities. If we set Jlf = 2, we have r=7i/2, so that 
the minor ABCD of order (r+1) contains two communalities, When this 
minor is expanded and equated to zero, we have a quadratic which may in 
some circumstances give two real solutions for the diagonal value between 
0 and -t-1. 

This problem has been investigated by E. B. Wilson and Jane Worcester* 
in several papers. They exhibit as an example a correlation matrix with 
n=6 and r=3. Their example is reproduced in Table 11, which shows the 
correlation matrix and two factorial resolutions, both for three factors and 
with different sets of communalities. In Table IS vre have another example 
from the same authors, which reduces to only one set of communalities. A 
second solution gives diagonal values that do not lie between 0 and -f-1. A 
third e.xample from the paper, “The Resolution of Six Tests into Three 
General I'actors," is shown in Table IS, for which the authors find no set of 
communalities between 0 and +1 that reduce the rank to 3. A higher rank 
must then bo assumed for this example. It is pointed out by the authors 

♦ E. B. Wilson and Jane Worcester, "The Resolution of Six Tests into Three GenereJ 
Factors," Proceedings of Ihe National Academy of Sciences, J£XV, No. 2 (February, 
1939), 73-77; and "Team Tests for Generals and Specifics," ibid.. No. 7, July, 1939, pp. 
358-64; also, E. B. Wilson, “Review of Crossroads in Ike Mind of Man [by T. L. 
Kelley]," Journal of General Psychology, II (1929), 153-74, esp. 156. 



Table 11 


Correhiien Matrix Faelor Matrix 



1 

2 

s 

i 

fi 

9 

I 

II 

III 

A- 

1 

hi 

.56 

.16 

.48 

.24 

.64 

.8 

0 

0 

.64 

2 

,66 


.20 

.66 

.61 

.86 

.7 

.6 

0 

.85 

3 

.16 

.20 

AS 

,18 

.07 

.23 

.2 

.1 

-.1 

.06 

4 

.48 

.66 

.18 

hi 

.30 

.72 

.6 

.4 

-.2 

.56 

6 

.24 

.61 

.07 

.30 

hi 

.41 

.3 

.6 

.4 

.60 

fi 

.64 

.86 

.23 

.72 

.41 

hi 

.8 

.5 

-.2 

.93 


AlUmatim Faelor Mairix 


I' 

II' 

III' 

A» 

.6624 

0 

0 

.426616 

.8684 

.4068 

0 

.902308 

.2463 

-.0269 

.0515 

.063569 

.7368 

.0699 

.0265 

.546623 

.3079 

.4774 

-.1530 

.386667 

.0810 

.0441 

.1835 

.998000 


Table IS 


CorreUUion Matrix 



1 

2 

8 

4 

6 

B 

1 

hi 

.66 

.10 

.48 

.24 

.64 

2 

.56 

hi 

.20 

.66 

.51 

.86 

3 

.10 

.20 

hi 

.08 

.27 

.18 

4 

.48 

.66 

.08 

hi 

.30 

.72 

6 

.24 

.51 

.27 

.30 

AS 

.41 

6 

.64 

.86 

.13 

.72 

.41 

A3 


Factor Matrix 


I II III *■ 


.8 0 0 .04 Factor mairix unigve 

.7 ,6 0 .86 

.2 .1 .4 .21 

.6 .4 -.2 .50 

.3 .5 .4 .60 

.8 .5 -.2 .03 


Table 13 

Correlation Matrix 



1 

2 

3 

4 

5 

C 


1 

hi 

.50 

.16 

.48 

.24 

.64 

No solution in 

2 

.56 

At 

.20 

.66 

.61 

.86 

three factors 

3 

.16 

.20 

Ai 

.18 

.07 

.25 


4 

.48 

.66 

.18 

hi 

.30 

.76 


6 

.24 

.61 

.07 

.30 

hi 

.33 


6 

.64 

.86 

.25 

.76 

.33 

AS 
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(“Team Tests for Generals and Specifics,” p. 362) that, ■when the number of 
tests is much larger than the number of factors, then M is negative, and the 
question of multiple solutions does not arise. 

It is of interest to note the number of independent conditions in the cor¬ 
relation coefficients for the resolution of n tests into r conunon factors. This 
is the difference between the number of independent correlation coefficients 
and the number of independent parameters in the factor matrix. It can be 
obtained from the inequality (7). Denoting the number of independent 
conditions in the correlation coefficients T, we have 

(34) T - , 

which has been written by Wilson and Worcester (in “The Resolution of 
Six Tests . . ..” and “Team Testa for Generals and Specifics”) in the form 

(35) T = i(n—r)^ — • 

When the number of independent conditions in the correlation coefficients 
is zero, the resolution is unique in the sense that no arbitrary parameter is 
involved in the solution but not necessarily in the sense that there is only 
one solution. In the numerical examples of Tables 11, 12, and IS, T=Q, 
since re=6 and r=3; but M=2, and hence multiple solutions may arise. In 
one example the solution is unacceptable because of diagonal values that 
exceed unity. 

These relations are of importance in dealing with factor problems in 
which the rank is as high as half of the number of tests. If the test battery 
can be so constructed that the rank is not more than one-fourth or one- 
third of the number of tests, then the question of multiple solutions for the 
communalities does not arise. 

The uniqueness of communalities is discussed further in a later section 
of this chapter. 

Adjustment of communalities for each factor 

In factoring a correlation matrix, one may adjust the communalities 
after each factor if residuals are computed. The simplest method of making 
this adjustment is to record in the diagonal entry the highest correlation or 
residual of the column. If the highest coefficient of the column is negative, 
one records this value in the diagonal with positive sign. This procedure is 
tiseful for large correlation matrices, and it can be used as a first approxima¬ 
tion for the factoring of a small table. The procedure will be illustrated by. a 
numerical example. 

In Table 14 we have a small correlation matrix of order 5X5 and rank 2. 
Although method No. 4 would be used only as a first approximation in fac- 
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toring a correlation matrix as small as this, it will be used here as a numerical 
example of the effects. The true eommunalities are shown in the diagonal 
cells of R. The first factor matrix was obtained with the group centroid 
method, using the known eommunalities. The second-factor residuals were 
then identically zero, and the obtained eommunalities were the true ones, 
as shown in the table. 

The second factor matrix was obtained by using the highest coefficient in 
each column as the estimated communality. The discrepancies for a small 
correlation matrix are then often marked. In the fifth column, for example, 
the highest coefficient in the column is .72, whereas the true communality 


Tabu 14 

Correlalion Matrix of Rank S 



1 

2 

3 

4 

6 

1 

(.64) 

.56 

.16 

.24 

.72 

2 

.56 

(.65) 

.38 

.40 

.67 

3 

.16 

.38 

(.40) 

.48 

.24 

4 

.24 

.46 

.48 

(.58) 

.34 

5 

.72 

.67 

.24 

.34 

(.82) 


Factor Matrix Computed with FaiAor Matrix Computed with 

Known CommvnaHHee Unknown ComrmmaliUes 



I 

ir 

h> 


I 

II 

A> 

DiBcrepaney 

1 


-.421 


1 

.703 

-.447 

.604 

.054 

2 

.806 

-.029 


2 

.812 

-.029 

.660 

.010 

3 

.486 

.404 

.399 

3 

.510 

.442 

.455 

.056 

4 

.624 

.437 

.580 

4 

.598 

.400 

.518 

-.062 

5 

.817 

-.390 

.820 

5 

.788 

-.376 

.762 

-.068 


is .82. Using these estimates, we obtained column I of the second factor 
matrix by the group centroid method. The correlational residuals were com¬ 
puted, and the diagonal entries were adjusted by recording the highest resid¬ 
ual in each column. ;^he second factor column II was then obtained. In 
the last column are shown the resulting discrepancies between the obtained 
eommunalities and the true values. It will be seen that the discrepancies 
are smaller, the largest discrepancy being .06. For large correlation ma¬ 
trices the discrepancies between obtained and true eommunalities are still 
smaller. 

In Figure 2 we have the true configuration of the five test vectors ob¬ 
tained from the first factor matrix of Table 14> These test vectors are repre¬ 
sented by solid lines in the figure. In the same figure we have superimposed 
the configuration obtained with the estimated eommunalities. These veo- 
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tors are shown in dotted lines. It will be seen that the configurations are es¬ 
sentially the same in spite of the coarse method of estimation of the diagonal 
entries for each factor. The second factor residuals do not vanish identically 
in this case, but they are so small as to discourage the attempt to write a 
third factor. 





In planning a factorial analysis it is desirable to cover the domain to be 
investigated as completely as possible with a large number of related vari¬ 
ables, which should be experimentally independent but correlated and rep¬ 
resentative of different aspects of the domain. When a study has been 
planned in this way, it will nearly always happen that every test vector lies 
near some other vector in the system. This arrangement is desirable for 
several reasons, principally in order to make it possible to discover a simple 
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structure if it exists in the domain. The same plan will also make it almost 
certain that the computing fonnulae, including the collinear graphic meth¬ 
od, will'be applicable in the estimation of communalities at the start so that 
the investigator is free to use any factoring method, including those which 
avoid the computation of residuals. The most troublesome correlation ma¬ 
trices are those which were not planned for factor analysis. In such cases the 
rank is often a considerable fraction of the order, and the computational 
problems then become more difficult. 

Further study of linear dependence 

Since this chapter was written, the method of estimating communalities 
by linear dependence of rows and columns (method No. 5) has been investi¬ 
gated further, and two papers have been written on this problem by A. A. 
Albert, of the Department of Mathematics at the University of Chicago.* 
The method of estimation of communalities by linear dependence of rows 
of R will be described here with computing foimulae and a numerical ex¬ 
ample. 



Fiqubh 3 


In Figure S we have represented the correlation matrix, partitioned as 
described earlier in this chapter. The symmetric submatrices, Rn, R 22 , and 
Rss, are here defined with zero diagonal elements. The corresponding diag¬ 
onal elements are given in the diagonal matrices Di, Da, and D 3 . It will be 
assumed that the correlation matrix has been inspected for clusters and that 
the number of distinguishable clustem represents a good estimate of the 
rank. In assigning tests to the three groups into which the correlation ma¬ 
trix is sectioned, it will be assumed that one test from each cluster has been 
assigned to the first group and that one test from each cluster has been as- 

* "The Matrices of Factor Analjrsia," Proceedings gf the National Academy 0 / Sciences, 
XXX, No. 4 (April, 1944), 90-95; and "The Mioimum Hank of a Correlation Matrix,” 
ibid., No. 6, June, 1944, pp. 144r-48. 




THE UNKNOWN COMMUNALITIES 


315 


signed to the second group. The result will be that the submatrices, Rn, 
Rn, Riii and Ra, are square and of order r where r is the number of clusters. 
The matrix iZss is square and of order (n~2r). The remaining submatrices 
may or may not be square. The underlying assumption is that if all the 
factors are represented in each of the first two groups, then the correlations 
of the third group can be accounted for as linear combinations of rows of 
either the first or the second group. This is the central idea of this method of 
estimating communalities. If a doublet cluster is found consisting of two 
tests which show unusually large correlation, then one test from the doublet 
is assigned to group 1 and the other test of the doublet is assigned to group 2. 
A doublet is fundamentally indeterminate as to factorial analysis, and it ap¬ 
pears as an ambiguity in the rotational problem. 

When the correlation matrix has been arranged in this manner and as 
shown in Figure 3, we can express the rows of jRsi as linear combinations of 
the rows of Ru. The transformation can be written 

(36) AUji = jSji, 

from which we can determine the transformation matrix A, since all the 
elements of the two submatrices are known and contain no communalities. 
We then have 

(37) A = R»i . 

It will be found that R^ is the only inverse that needs to be computed. If it 
is found that i2zi does not have an inverse, then either the assumed rank is 
too high, so that its determinant vanishes, or the clusters have been chosen 
inappropriately. 

When the transformation matrix A has been determined, we express the 
rows of iJsB as linear combinations of the rows of Bjj by the same transforma¬ 
tion, and we then have 

(38) = Rsi “t" Ds. 

The side correlations of this matrix must agree with those of the aubma- 
trix Ris. If this is not the case, then the rank has probably been assumed 
too low. If this agreement is obtained, then the diagonals are those of R 33 - 
The communalities of Eas are then known. 

Applying the same transformation to Ejj, we have 

(39) A(i?2a -f" Di) = Rs2 , 
or 


(40) 


■Baa — ARt 2 = AD 2 . 
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We compute the left member of this equation. The ratio of each column 
sum to the corresponding column sum of A is then the desired communality 
for the corresponding column of Ra* 

The same process is carried out for the remaining set of three subinatrices. 
The rows of Rat can be expressed as linear combinations of the rows of 12,2, 
and wo then have 

(^1) BRii = Eaa, 

so that 

(42) S = 12,2 Era'. 

We can write this equation in terms of the inverse already computed, and 
we then have 

(43) R' = 22ii‘Sa3, 
so that 

(44) B = (I2i-i RaaY. 

Applying this transformation to 12 u, we have 

(45) B{Rii -|- Di) = 12,1 

or 

(46) S22n + BDi = R^i, 
so that 

(47) BDi = (12,1 - BRu) . 

The ratio of the columns of the light member to the columns of B give the 
corresponding estimates of the communalities of Rn. 

Table^ 15 shows the computations for this method of estimating com¬ 
munalities which is illustrated on a correlation matrix of order 6 and rank 2. 
The summarized computations follow the outline as shown. 

A limitation of this method for experimental data is that the rank is 
never exactly r where r<n and that the determinations will therefore be ap- 

In practice one can save computational work by finding only the column sums be¬ 
cause these enter into the determination of elements of D,. 
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proximate. Even when the approximate rank r is adec[uate, as far as corre¬ 
lational residuals are concerned, the present .method may, nevertheless, 
show discrepancies in the estimated communalities for experimental data. 
The method has not yet been tried extensively enough on experimental data 
to show whether it is preferable to the simpler methods of estimation. The 
method is certainly amply justified for correlation matrices in which the low 
rank is exact or veiy closely approximated. 

In the two papers on the communality problem Albert defines the ideal 
rank of E as the largest order of a non-vanishing minor of R which does 


Table IB 



1 

2 

3 

4 

G 

0 

1 

.00 

.72 

.61 

.92 

-.26 

.59 

2 

.72 

.00 

.80 

.68 

.20 

.68 

3 

.61 

.30 

.00 

.54 

.40 

.69 

4 

.92 

.68 

.54 

.00 

-.39 

.55 

S 

-.26 

.20 

.40 

-.39 

.00 

.21 

6 

.59 

.68 

.60 

.65 

.21 

.00 



.61 

.80 

RtlRtt = 

-1.8181 

- .0909 


.92 

.68 

(43) 

1.8863 

.9318 =B' 



-2.1170 

2.4006 




2.8042 

-1.8991 

B=<-1.8181 

1.8863 


- 



- .0309 

.9318 





»a= —1.9090 

2.8181 


A=RsRti^= 

1,1233 

-1.0274 




(37) 

.6986 

.1781 




«i = 

1.8219 

- .8403 

-1.6181 

1.5090 = 

BDi 



(47) - .0809 

.7454 


_ 



«4=-1.6990 

2.2544 



.860 

.210 





.210 

.580 







hi 

hi 





* 4 / 83 '= .8900 

.8000 


ARii “ 

.9648 

- .9968 

= AD2 - 



(40) 

.6938 

.1728 





1,6486 

- .8238 





M 

hi 

hi hi hi 

hi hi 

K 

Sj/Si= 

.8500 

.9700 

.890 .800 .850 

.970 .850 

.580 
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not conWn diwnal elemenli. He proves the interesting theorem that it 
Ihe Airatii r o/R« oise Ik rank of ifa submlrm Ea ani E„, !tei iJe 
mi m^ mmmaliliis mk iM tk rmMn meUm malm R has 
, '■ “ *" encouraging finding because it has been assumed in the de- 

veiopmmt of mnltiple-facto anaiysis that there exists a unique set of com¬ 
munities which are consistent with the experimentally given off-diawnai 
cone atons. The existence of such a set of communaiities merely maintains 
rani of the oli-dingonal entries, which Albert has called the ideal rank 

oElthadpreyiously been pointed out by E.B, Wilson thatifthenumber 

0 teste is much huger than the number of factors (»>r), then the question 
of multiple solutions for the communalitiea does not arise. 



- j V —>-****«WVU 

Since tte chapter was set in type Mr. Frank Medland has completed a 
Masters dissertation, entitled "An Empirical Comparison of Methods of 
Community Estimation." Nme methods of estimating en mm.m.inif ^ 

erapk No. 2 These communahty estimates were compared with com- 
mm^ities thrt were computed by the centoid method, with diagonal 
ijustinent rter each factor. Medland found that the centroid forlula 
f eqMton (16) gave the most consistent communality estimates. Prac- 

that is 

eptesenfed by equato (30). Since the centroid formula of equation ( 15 ) 



CHAPTER XIV 

THE SIMPLE-STRUCTURE CONCEPT 


The score function 

Simple structure has been briefly mentioned in previous chapters, but it 
will be considered here in more detail as to its significance and implications. 
The principles of simple structure are fundamental in making factor analy¬ 
sis a scientific method rather than merely a method of statistical condensa¬ 
tion, and it is therefore one of the central themes in factorial theory. Some 
writers on factorial theory have not yet accepted this concept as a powerful 
aid in exploratory factorial investigation. It is surely not the only way to 
resolve the problem of finding a significant reference frame, but it has so 
far yielded some very illuminating results. 

Consider a set of measurements Syi of individuals i in traits j. The meas¬ 
urements selected for factorial study ai’e correlated, and hence they can be 
assumed to have some parameters in common. Let the measurements be 
expressed in terms of these parameters by the equations 

•I'if, • • • I ‘ • I / 
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Here we have each measurement s,i for individual i expressed in terms of r 
parameters Xpi, which are descriptive of individual i. The functions <i>j are 
in general non-linear, and they are unknown. They may be assumed to be 
unique for each measurement j. If a measurement Sj does not depend on a 
parameter Xp, then that parameter is absent in the function (ftj, Eveiy pair 
of measures, j and k, will be assumed to have one or more parameters in 
common if ryjT^O. If ry*=0, they may or may not have parameters in com¬ 
mon. 

For any given list of n measurements Sj, let there be q parameters in¬ 
volved. Some of these parameters will be unique in that they are not in¬ 
volved in two or more of the score functions Sj. We limit the analysis to the r 
parameters which are involved in two or more of these score functions and 
which determine correlation between the scores. It is this set of r parameters 
that determines the side correlations and the intercorrelations ryt, where 
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j 7^ k. The (g— r) unique parameters influence only the diagonal correlations 
rjf, which are eliminated from the analysis in order to make the problem 
soluble. If we knew all the parameters and all the functions we should 
probably be able to design a set of measurements for any set of parameters 
so as to maJce a determinate solution, irrespective of whether the parameters 
were common or unique. But when the parameters become known, there 
will be no provocation for factor analysis. It is our ignorance about the 
parameters and the score functions that prompts us to use the exploratory 
factorial methods. In our present state of knowledge we are likely to add 
unique parameters with every new measurement, so that we are likely to 
have q>n, a situation that involves more parameters than there are meas¬ 
urements for each individual. 

Any particular list of r parameters defines a domain, which includes all 
possible measurements that are determined in whole or in part by these param¬ 
eters. In practice, a domain is defined by a field of related measurements, 
since the underl 3 dng parameters are unknown. A domain is described in 
practical work in terms of the content and nature of the measurements, such 
as auditory perception or visual illusions or speed performances. The com¬ 
plexity of a measurement Sjia the number of parameters Xp that it involves 
and which it shares with one or more other measurements in the battery. 
Hence the complexity of a test or measurement is dependent on the test 
battery in which it is being analyzed. The complexity of a test j is, in part, 
dependent on the test battery. When we speak of the complexity of a single 
test apart from a test battery, we refer to the total number of parameters 
in the score function Sj, 

Consider a table of order wXr, in which each cell represents a parameter 
for a particular test. Each row represents a function 0y, and each column 
represents a parameter. The complexity of a battery of n tests is r, and it 
should be the aim of the investigator to choose a set of n tests or measure¬ 
ments for the domain which he is studying so that n>r. His scientific in¬ 
tuitions and hypotheses are his chief guides here. If the score functions were 
known, we could mark an a: in each cell (jp) to show that a parameter X, is 
involved in the score function ^y, and we could leave blank each ceU (jp) in 
which the parameter Xp is absent in the score function ^y. We call such a 
table & factor pattern (see chapter ix for different types of factor patterns), 

If an analysis is to be made by the principles of simple structure, then the 
investigator gambles that the complexity of each test or measurement is 
less than the complexity r of the battery as a whole. He hopes that the test 
complexities are considerably less than that of the batteiy. If the test com¬ 
plexities are less than r, then there will be one or more blank cells in each 
row of the factor pattern. Such a pattern will be considered as evidence of 
an underlying simple order in which each parameter or process in the domain 
is not involved in every test measurement. If the parameters are uncorre- 
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lated in the experimental population, then the pattern will be indicative of 
an orthogonal simple order for that population, If the parameters are corre¬ 
lated in the experimental population, then the pattern indicates an oblique 
simple order. The question of whether the parameters are correlated or un- 
correlated among the subjects who happen to be used for studying the do¬ 
main is, in general, a secondary matter when compared with the scientidc 
problem of discovering an underlying order in the Hnma.in 

The score functions Sj may be represented by a surface, as in Figure 1. 
In this figure we have considered only two of the parameters, Xi and Xa, as 
well as the score Sj. If the score Sj is independent of Xa, then the surface 
Sj will be a cylinder parallel to Xa. (A cylinder is, of course, not necessarily 
circular in section. I is a surface parallel to an axis.) An individual with 
parameters xu and Xai will have a score Sa as shown, and this score will be 



independent of the parameter Xa. This reasoning can be extended to n di¬ 
mensions. If the surfaces could be constructed or otherwise represented, 
the cylindrical forms of the surfaces could be taken as clues for locating the 
reference frame, especially if a number of such surfaces were found which 
defined the same axes in this manner. If a reference frame could be de¬ 
termined by the cylindrical surfaces, it could be expected that the axes, so 
determined, would represent parameters for which some physical or opera¬ 
tional interpretation could be made. It would not necessarily follow that 
such a reference frame would be the only feasible one, but the simple order 
indicated by these axes should be illuminating in the exploratory study of a 
domain for which no hypotheses are available. Each axis should represent 
some underlying process, parameter, or category which may or may not have 
been suspected in setting up the test battery. Unfortunately, these surfaces 
are not immediately available in the measurements and their relations, so 
that approximations must be used. 
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There are certain characteristics of the surfaces Sj which may be sur¬ 
mised by psychological considerations. Moat of the factorial studies have 
been made with those mental traits which can be called "abilities.” An 
ability may be considered to be any trait which describes how well a person 
can do something. It has been observed that all such traits have correla¬ 
tions that are positive or zero, -and this seems to be the rule for the most 
diverse abilities. The parameters that underlie individual differences in the 
mental abilities may be tentatively assumed to be of such a nature that they 
are covariant with the overtly manifested abilities. If that should be found 
to be acceptable, then we should be able to infer that the surface Sj rises 
with an increment in any of the underlying parameters X^. By these psy¬ 
chological considerations we should infer that 


( 2 ) 


0 


for those traits that are classified as abilities. In other words, the surfaces 
Sj for mental abilities may be assumed to be monotonic increasing functions 
of the parameters Xp*. If this inference is acceptable, then it should be pos¬ 
sible to represent all the surfaces Si reasonably well with second-degree 
equations for the mental abilities, barring what might seem now to be 
strange irregularities or discontinuities in the second derivatives. 

While th^e characteristics of the surfaces/Sy may seem plausible for the 
mental abilities, there do not seem to be any similar obvious restrictions for 
the surfaces that represent temperamental traits. If some of these surfaces 
are characterized by conspicuous maxima and minima, then the observa¬ 
tion equations for them might have to be of the third or higher degree. 
Gross discrepancies and large residuals may then be found in the crude 
linear assumptions on which present-day factorial methods are based. Most 
of the statistical methods in current use involve the same assumption. 

The vmous rating schedules for personality traits are frequently ar- 
ra,nged with special reference to social acceptability and success rather thn.Ti 
with reference to the degree of some underlying trait. Such ratings may 
give trouble in factorial studies if the relation between the amount of some 
underlying trait and the rating on some kind of social acceptability has 
a maximum for an optimal amount of the underlying trait. The assumption 
of linearity between the underlying parameters and the overtly observed 
social acceptability is then violated more seriously than if we were dealing 
Wit personality descriptions that are monotonic increasing or decreasing 


* H time per unit task is used as a score, then the score function is decreasing 
monotomo, m which ewe it can be reversed so that aU correlations become positive. This 
applies to abilities and not to all psychological measurements. 
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functions of the underlying parameters. An example may clarify these re¬ 
strictions. Let us suppose that one of the important underlying parameters 
in describing a man is the rate at which he moves generally. A person with 
a very low value of this parameter would be described as slow, inert, and un¬ 
responsive. The upper extreme of this parameter would be described as a 
personality that is jerky, scatterbrained, nervous, irritable, and perhaps 
unstable. An optimum value between the extremes is likely to be associated 
with more favorable descriptive categories as regards social acceptability 
and success. The sketches of Figure 2 are drawn to show that a monotonic 
increasing or decreasing surface can usually be fitted better by a linear ap¬ 
proximation than can a surface with conspicuous marima or minima. 



In Figure S we have represented two plane surfaces which may be thought 
of as best-fitting planes for the score surfaces S,- and S*. The score surface Sj 
of Figure 1 represents raw scores. Such a surface also could represent stand¬ 
ard scores by merely moving the origin to the level of the mean and adopt¬ 
ing a vertical scale with the standard deviation as a unit of measurement. 
With this translation of the origin and with the stretching factor, we have 
the planes passing through the origin as shown in Figure 3. It is of some 
interest to note, in passing, that the rank of a matrix of raw scores is reduced 
by 1 when the scores are modified to deviation scores abovi the mean. 

The two vectors J and K in Figure 3 are unit normals to the planes Ss and 
Sk, respectively. The direction cosines of each normal are also the coeffi¬ 
cients of the equation of the corresponding test score plane. If a surface Sj is 
cylindrical and parallel to some axis Xp, then the best-fitting plane for that 
surface is also parallel to that axis except for the accidents of sampling. 
The direction cosines of the normal to the plane will have a zero-direction 
cosine for the axis Xp. The vectors J and K axe unit test vectors in the total 
test space. If and X 2 axe correlated and if a number of test vectors are 
orthogonal to them so that these axes are chosen for the oblique factorial 
matrix Vjp, then the test vectors will have zero projections on these axes 
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and the corresponding entries in the factor matrix will be zeros. In this 
manner we see that if a number of teat score surfaces Sj are cylindrical and 
parallel to each other, then the corr^ponding axis is chosen as a refer¬ 
ence vector and is represented by a large number of zero entries in a column 
of the oblique factor matrix. 

The relations of Figure 1 may be used to illustrate another fundamental 
principle in factor analysis as regards the scientific interpretation of a simple 
structure when it is found. Suppose that there are individual differences in 
the ability to visualize space. A test battery could be assembled, including 
visual tests that do not involve this factor and other visual tests that do in¬ 
volve it. The factorial separation would sustain the hypothesis that such a 



factor IS distinguishable among visual functions. If a parameter or factor or 
function exists which becomes operative in some way in the visualizing of 
space and not in other visual tasks, then we should expect those score sur¬ 
faces to be parallel to an axis which does not involve the particular param¬ 
eter. If the separation of the score surfaces actually agrees with the classi¬ 
fication of the tests as including or excluding the particular function, then 
the fa^torisl results sustain the hypothesis, 

The principle of interest here is that the identification of a factor or 
parameter does not presuppose the experimental population to bo in any 
sense representative of any sort of hypothetical general population. In fac¬ 
torial studies that are made for the discoveiy of an underlying order in a 
domain, the best procedure is not to select a random group of subjects, 
but rather to select the subjects so that their attributes are as diverse 
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as possible in the domain to be studied. Two or three freaks in the charac¬ 
teristics of interest are worth more than fifty average subjects. This prin¬ 
ciple is not new. If you wanted to inquire informally about the existence of 
the ability to visualize space, you would gain most by selecting some drafts¬ 
men or engineers and some people who evidently avoid visualizing tasks and 
methods of thinking. Later, when the factor had been identified clearly on 
exceptionally gifted or deficient individuals, you could proceed to the task 
of establishing norms to determine the actual range of ability in random 
samples of the general population. Here, again, we see how the purpose of 
a factorial study determines the kind of subjects to be selected for the ex¬ 
perimental group. If we have no hypotheses about the kind of people who 
differ fundamentally in the domain to be studied, then we proceed by in¬ 
viting any conveniently available group of subjects in the hope that they 
will differ markedly among themselves in the several parameters or factors 
of the domain to be investigated. If a few subjects can be found who are 
known to differ widely in the domain, they should be included. No assump¬ 
tion of normality of the distribution is involved in factorial analysis. If we 
could find bimodal distributions for some tests and factors, they would be 
especially interesting, provided, of course, that the bimodalities were not 
artifacts. The question of whether the correlations between the tests in an 
experimental population are in any sense representative of a general popu¬ 
lation is irrelevant. Nor does it matter whether the correlations for one ex¬ 
perimental group differed markedly from the correlations of the same tests in 
another experimental group. If the factorial analyses are made independ¬ 
ently, the same factors should be identified, but the numerical values would, 
of course, be different if the groups differ widely. The correlations for each 
group are determined by the factors involved in the tests and by the corre¬ 
lations of the factors in each experimental group. 

We have defined the domain as the field of aU possible measurements 
that are determined, at least in part, by a set of parameters. In exploratory 
studies the domain is defined tentatively in terms of the content or nature 
of the tests of a battery. The principal purpose is to discover the param¬ 
eters or factors and something about the nature of the individual differences 
that they produce. The individual subjects are examined, not for the pur¬ 
pose of learning something about them individually, but rather for the pur¬ 
pose of discovering the underlying factors. Ultimately, we want to be 
able to appraise each individual as to each of the factors, but this problem 
raises certain other questions about the domain. 

In setting up the fundamental linear observation equation for factor 
analysis, the individual score sa is expressed in terms of the test coefficients 
Cjm and the individual scores in a set of arbitrary orthogonal factors x„i. By 
rotation of axes the scores can be expressed as linear combinations of indi- 
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vidual scores in the primary factors p instead of the arbitrary factors w. 
Some writers have attributed to factor analysis the assumption that all the 
subjects in an experimental group use the same factors in doing a test but 
such an assumption is not made in factor analysis. Suppose that a task can 
be done in one of two ways that involve either of two factors, 1 and 2. Sup¬ 
pose, further, that some subjects use factor 1 and that other subjects prefer 
factor 2 in doing this task. If this test is included in a battery for factor 
analysis and if the battery contains other tests by which factors 1 and 2 
can be clearly differentiated, then the test in question will have a complexitv 
of at least 2. We should then infer that the test has these two factors in 
that % and are nori-vanishing in the factor matrix 7; but it would not 
follow that e^h individual subject used both of these factors in doing the 
test. To decide whether this is true, one turns, first, to introspection in 
doing the task to ascertmn whether it seems psychologically necessaiy that 
both factors should be simultaneously used, or whether it is a question for 
each subject to decide which method to adopt in doing the test. Here one 
must be careful not to be biased by one’s own preferred ways of doing 
things. In case of doubt, we ask a number of subjects how they did the task 
including the instructions and fore-exercise, and to describe any useful 
tricks or dodges that they may have discovered in doing the test. These in¬ 
formal reports are sometimes very illuminating. A little experience of this 
kind soon emphasizes the importance of introspection as compared with 
ca^al judgments about the factorial composition of a test merely by a su- 
perfimal inspection of its content. For example, a syllogism test about the 
relative statures of three men was found to have a significant saturation on 
the space factor, although the test was entirely verbal in appeai-ance. It 
was found that some subjects, but not all, used simple diagrammatic repre- 
sentation 0 the premises such as “S-J" to represent the premise that 
Smith IS taller than Jones, so that the inference was also spatially repre- 
sented. In order to make the analysis more complete, one might separate 
the subjects mto two groups according to preferred methods of doing a test 
an reanalyze the results. In such a situation we should expect to find a 
different factonal composition of a t®t for the two groups of subjects 

alWpH which the factorial composition of a test can be 

altered is that m which the subjects are given instruction in doing a task. 

since the test is itself 

Xtinswr though the test form remains identical 

^tt®r all, the psychological nature of a test is determined by 

the factorial composition of a test is changed 
tite S ®“hjecta. Sometimes we have arranged the order of the 

tests in a battery with reference to the suggestive effects of one test on a 
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following test, especially if one test requires a mental set siinilar, or oppo¬ 
site, to that of a previous test. Fortunately, these overlapping effects are 
not often serious. 

When it comes to the problem of using the tests, not for the purpose of 
identifying mental factors, but for the purpose of appraising the factors in 
each individual, we resort to the same methods that are in current use with 
psychological tests. The best that we can do is to determine the correlation 
of each test with each primary factor, r/,. These are the validity coefficients 
of the tests with respect to the primary factors. We select several tests 
whose validities are the highest available for a particular primary factor 
p. These several teats are pooled in a composite. The composite score is 
then used as the beat available estimate of the individual’s score in the 
primary factor p. If each test has saturations in several factors, such as 
(1, 2), (1, 3, 5), (1,4,7), then we try to distribute the distracting saturations 
for other factors so as to emphasize the validity for one of the factors. The 
same result can be obtained by multiple correlation analysis in the usual 
ways where rjp are validity coefficients which should be studied with the 
intercorrelations of the separate tests. 

Simple structure in r dimensions 

The simple-structure principle will be restated here for r dimensions. 
Some of the previously given definitions will be repeated in this context.* 

The r orthogonal reference vectors that are implied in the orthogonal fac¬ 
tor matrix F are called orthogonal reference vectors. These vectors are re¬ 
garded as a fixed orthogonal frame in terms of which the various factorial 
relations are expressed. It is this fixed frame in terms of which we describe 
the test vectors j in the rows of F, the r hyperplanes of an orthogonal or 
oblique simple structure, and the primary trait vectors. These fixed orthog¬ 
onal axes are referred to by the subscript m, or M and m if two subscripts 
are desired. Thus the test vector j has the projections a/m on these orthog¬ 
onal axes, as shown in the rows of F. When this reference frame is deter¬ 
mined by some form of the centroid method, the frame wiU be called centroid 
reference vectors. 

The unique configuration of trait vectors defined by the correlation ma¬ 
trix is called the correlational configuration or the ircdi configuration. This 
is the configuration described in terms of the fixed orthogonal frame by the 
factor matrix F. The combination of the correlational configuration and 
any set of reference vectors is called a structure, and it can be seen that a 
structure is itself a configuration of (n-l-r) vectors. The problem is to sub¬ 
stitute for the arbitrary reference frame another frame, orthogonal or 
oblique, which will have scientific interpretation. Each reference vector of 


* First ed., chap. vi. 
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the new frame should represent a scientific category, a parameter, or a 
function in terms of which the trait configuration can be interpreted. 

The r linearly independent reference vectors define the same number of 
co-ordinate hyperplanes. Each hyperplane is a subspace of dimensionality 
(r—1), and it is defined by a reference vector. The subspace of (r—1) di¬ 
mensions which is orthogonal to the reference vector A, will be called the 
co-ordinate hyperplane Lp. If a reference frame can be found such that each 
test vector is contained in one or more of the r co-ordinate hyperplanes, then 
the combined frame and configuration is called a simple structure. If the 
new reference vectors are orthogonal, the total configuration is called an 
orthogonal simple structure. If a set of r hyperplanes of dimensionality (r—1) 
exists such that each teat vector is in one or more of the hyperplanes and if 
the noi-mals Ap are oblique, then the total configuration of test vectors and 
reference vectors is called an oblique simple structure. It follows from these 
definitions that each test vector that contributes to the identification of a 
simple structure must be of complexity less than r. A configuration of test 
vectors which defines a simple structure will be called a simple configuration. 

If an nXr factorial matrix is set up with arbitrary entries in all cells, 
there is, in general, no transformation by which each of the n variables can 
be described in terms of fewer than r factors. It is assumed that n is large 
in comparison with r. Therefore, the appearance of simple structure in a 
factorial matrix derived from observation commands attention. It is not a 
chance matter. When found in experimental data, it reveals order within 
the n variables, in that r<n categories are required for describing them col¬ 
lectively and fewer than r categories are required for each one of them 
separately. 

If an underlying physical order of the n traits is such that each of the 
traits can be described in terms of a smaller number of factors than are re¬ 
quired for describing the traits collectively, then the underlying physical 
order will be called a simple order. 

If a simple order exists for a set of n traits and if the r factors are statis¬ 
tically independent in the experimental population, then the corresponding 
physical order will be called an orthogonal simple order. Hence the configu¬ 
ration which represents an orthogonal simple order among the n traits is an 
orthogonal simple structure. An order among the traits involves, of course, 
not only the traits themselves but also the categories in terms of which they 
are described. These categories are themselves traits which may or may not 
be experimentally isolable. 

It is useful to summarize the several fundamental concepts in this anal¬ 
ysis. The concept order refers to the relation between the traits and the 
categories in terms of which the traits are to be described and compre¬ 
hended. The correlational matrix describes merely the relations among the 
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traits, independent of the descriptive categories. The factorial matrix de¬ 
scribes the traits or variables in terms of a set of descriptive categories. The 
trait configuration is a geometrical representation of the correlational ma¬ 
trix, and hence it is also independent of the descriptive categories, The 
structure is a configuration which represents not only the traits but also the 
descriptive categories. The scientific problem is essentially a search for a 
set of descriptive categories in terms of which our conception of the traits 
or variables is the simplest possible. If an overdetermined simplicity in our 
conception can be achieved, then the traits or variables wiE be said to re¬ 
veal a simple order. The search for these categories has its direct analytical 
counterpart in the search for a set of reference vedms which will reveal a 
simple structure. A simple structure is a configurational representation of a 
simple order. If the simplifying descriptive categories happen to be statis¬ 
tically independent in the experimental population, then the trait configura¬ 
tion can be so rotated in its arbitrary orthogonal frame that each trait vec¬ 
tor is contained in one or more of the r orthogonal co-ordinate hyperplanes. 
The result is an orthogonal simple structure, and the reference vectors repre¬ 
sent a set of statistically independent traits that serve the simplest possible 
comprehension of the given traits or variables. 

Alternative simple structures for the same domain 

We should distinguish between uniqueness of the simple structure for a 
given correlation matrix and uniqueness of the descriptive parameters or 
concepts which the primary axes represent. In earlier chapters we have con¬ 
sidered examples, such as the cylinder problem and the box problem, in 
which the simple structure does not give the only meaningful set of param¬ 
eters or descriptive concepts for a configuration. It is unlikely that unique¬ 
ness in that sense could be found in any domain. Eurthermore, it is con¬ 
ceivable that a domain could be represented by two sets of measures which 
would show two different simple structures, if the two sets of measures were 
taken in quite different ways. Both sets of primary axes would then repre¬ 
sent underlying parameters for which meaningful interpretation could be 
expected. The two sets of parameters could be regarded as alternative sets, 
and they should be revealing as to the nature of the imderlying order. 

The box problem, which can be easily visualized, has served to illustrate 
these principles. Consider one set of measurements of the boxes which are 
simple functions of the three independent edges, as in the previous examples. 
Consider also another set of conceivable measures of the same population of 
boxes in which each measure is some simple function of the basic parameters 
for volume, v, and the ratios t=x/e and u=x/y. The three measures v, t, 
and u ai'e superimposed on the simple structure x, y, and g in Figure 4 . 
The basic measures x, y, and g might represent width, height, and depth. 
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respectively. It la instructive to see wliat would happen with different sets 
of me^urements of the boxes. Fiist, consider the case in which we ineret 
add the three me^ures t, and u to the measures previously listed and 
which contribute to the simple structure of the box problem. The result 

thTtHn^n same triangular arrangement of the measures forming 

the triangle x, y, and a, and there would be the three additional measures 
V, u, and <, which would not contribute to the identification of the simple 
tructure. In the first example of the box problem we had two such meS 
r®, namely, 16 and 17, which represented the volume and the principal 
diagonal of each box. These did not participate in the simple structure 



so 00 ^ 00 ^ measurement which were 

t- t aX tLi combinations of the three measures 

n we d?' configuration x. y, and « would not be seen, 

we proceeded to construct this new simple structure, we should have 

s'ZTart A. “■! 

should then he nl 1 + twenty others similarly constructed. We 

Sd Lmv rr' *“ would 

S rTr. “‘'“to" 0. i, » waa ob- 

S aT^S^r “ oonfleuration and than arbi- 

5. r f” “ "'w battary, than, of 

d^ii^ta “d it would 

demonateote nothme regarding the underlying order tor the domain. If an 
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author were caught doing such a thing, his scientific honesty would be 
questioned unless he presented it merely as some sort of stunt. The arbi¬ 
trary character of his battery of measurements would be questioned. 

But there could be situations in which the new structure v, t, u would 
be valid and significant. Suppose that these new parameters were signifi¬ 
cantly related to the manner in which the box shapes were generated or in 
which they were used or interpreted. Then an investigator who assembled 
a battery of measurements to represent the domain might find the structure 
V, t, u, and it would serve him in studying the underlying order. The as¬ 
sembled battery would reveal its organization in the new structure. 

Let us suppose that two investigators found these two simple structures, 
using two different batteries of box measurements. Each of theTn might find 
a set of primary factors, and each might succeed in discovering some 
appropriate interpretation for his own set of three basic parameters. 
Such a finding would not necessarily show that one of them was wrong 
They might have found two sets of alternative parameters for describ¬ 
ing different aspects of the domain in question. The challenge is then 
to study closely the two sets of measures to see what different aspects 
of the domain they cover. A new factorial experiment could be set up 
with both seta of measures in the same battery, and the configuration 
would then be like Figure 4. Additional factors might appear because 
the previous specifics might appear as common factors in the new analy¬ 
sis; but our present concern is about the principle involved in the possi¬ 
bility of alternative structures. This would be a case in which there would 
be more hyperplanes defined by the test vectors than there are dimen¬ 
sions in the common-factor space. Such a situation should not be regarded 
as a failure in factorial analysis. It might reveal alternative sets of param¬ 
eters in the domain, which should all eventually be interpreted. So far we 
have found only an occasional suggestion of secondary hyperplanes, but 
none of them have seemed to us to be sufficiently overdetermined to justify 
special investigation. 

In judging the difference between alternative structures that should be 
separately interpreted and the artifact which could be arbitrarily con¬ 
structed from any teat battery, it is well to look at the nature of the meas¬ 
urements involved. Both sets of measurements should be natural and ap¬ 
parently relevant measures descriptive of the domain in question. If one 
set of measurements consists merely of a set of linear combinations of a 
few previous measm-es, or the equivalent as to arbitrary character, then its 
relevance to the problem of analyzmg the domain may be questioned. In 
any event, subsequent factorial study of the same domain should reveal 
whether a previously found structure is to be sustained. 
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Uniqueness of primary factors 

One of the most fundamental problems in factor analysis concerns the 
uniqumess of the primary factors and their interpretation. When a factor 
analysis has been completed with a clear simple structure, the first question 
is naturally: “What are the parameters or factors?” It seems to be in the 
nature of science that such a question has no unique answer. In scientific 
work a parameter is one of the measurable attributes of an object in terms of 
whii^ it is desmbed. In general, one tries to choose a small number of 
parameters which define all the relevant attributes of the object. The au¬ 
thor is successful if he finds a small number of easily comprehended param¬ 
eters that cover his problem. Parameters in scientific work and the con¬ 
cepts which they represent become the conventionalized chapter headings 
in textbooks. Even notation becomes a matter of convention. A circle on 
a graph is defined by the two co-ordinates (x, y) of its center and by the 
radius r. These parameters are easily underatood and easily used in most 
problems, but, of course, they are not unique. For some problems they 
would be awkward, and another set of parameters would be chosen The 
same is true in scientific work. The familiarity of mass, momentum’, and 
acceleration should not lead us to suppose that they are necessary absolutes 
for the description of objects in motion. If these reservations about the 
umqueness of parametera apply to physical science, it would seem wise to 
acknowledge them also in the search for descriptive parameters or function¬ 
al umties of mind. 


The choice of a set of fundamental concepts in terms of which any do¬ 
main of nature is to be coinprehended is probably meaningless to nature. 
The choice is for us to make in terms that will attain intellectual control and 
consistency, as empirically determined, and by which this control con be 
a tamed, as far m possible, with ideas that are already familiar to us. Fun- 
dmental scientific concepts that are successful in this sense are as social as 
other inventions. To hunt for a unique solution in the comprehension of a 
set of related phenomena is an illusoiy hunt for absolutes. It is probably 
safe to say that an apparently unique set of concepts in any domain is mere¬ 
ly the symbol of our immaturity in the exploration of that domain. The 
recognition of the lack of uniqueness in scientific concepts does not imply 
that some sete are not more useful and fruitful than others. Those param¬ 
eters are preferred which reveal the phenomena as of a simple underlying 


Recognition of the fact that descriptive parameters are not unique has 
led some writers on factor analysis to give up the problem in defeat. They 

XTerP wrfi s*‘>'«ftically determined parameters or factors 

T? ^ determined by the circumstances of the experiment at the 
moment. The simple-structure concept was invented, if anything so simple 
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can be called an “invention,” as a compromise with this problem. It was 
the simple idea of hilding the smoUcst nuTnhev of poretTneieTS fov desevibiTig 
each test. In numerical terms this is a demand for the smallest number of 
non-vanishing entries in each row of the oblique factor matrix. It seems 
strange indeed, and it was entirely unexpected, that so simple and plausible 
an idea should meet with a storm of protest from the statisticians. This 
simple idea has turned out to be a much more powerful analytical device 
than was at hrst anticipated. 

The primary factors that are identified by the simple-structure principle 
seem to be unique in the sense that they reappear in succdssive studies with 
different test batteries in the same domain. It is to be expected, however, 
that a primary factor may be found to be itself a complex when a part of a 
domain is investigated with large test batteries. It will then give place to 
several new primary factors, which should retain their identity in successive 
test batteries that are adequate to isolate them. As regards psychological 
interpretation, it may be expected that this will also be modified or extended 
with repeated studies. The number factor, for example, has been named so 
far only in terms of the numerical content of the tests, but this type of in¬ 
terpretation cannot be regarded as satisfactory. The psychological inter¬ 
pretation should be made eventually in terms of psychological processes 
that will generally transcend test content except in those cases in which the 
test content and the psychological processes are described by the same 
name. In order for the interpretation of primary factors to be satisfactory, 
their psychological interpretation should be sufficiently clear so that the 
factorial composition of new testa can be predicted with confidence. Prog¬ 
ress has been made in that direction, but this goal can be attained only after 
many factorial studies of the same domain. 

Analysis of a large number of factorial studies seems to indicate that those 
tests which are of low complexity and which, consequently, are the best 
indices of the nature of a primary factor are generally quite simple as judged 
by usual psychological considerations. However, a test which seems simple 
without a knowledge of the primary factors may seem to be rather complex 
after the primary factors are underatood. Tests of high complexity, such as 
a mental age score, cannot be expected to contribute to the identification of 
primary factors. Job analysis in the future will be done in terms of known 
primary factors, so that counseling and employment procedures can be de¬ 
signed on rational grounds rather than, as at present, by a hit-or-miss hunt 
for acceptable validities for each particular task. 

In the work of finding a set of fundamental psychological categories for 
the description of mental traits it should be possible to supplement the 
simple-structure principle by other principles. In psychological work the 
choice of a set of basic parameters for describing mental traits could be fa- 
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cihtated by examining their genetic basis and by noting (lie order imH ti 
rate of development of the different fnm-tions. Thus, for exaninle ih 
ability to do the Street Gestalt Completion test seems to bo a funet on 
that matures very early, perhaps as early os six or seven years, while the 
verbal factor seems to show continued growth through the high-school 
years The growth of the verbal factor may be explained by the iniperfec 
tion of present tests, which are markedly influenced by .schooling and ex' 
perience or by slow maturation of the ability itself. At any rate, the priinarv 
factors which are identified by the study of individual differences at poiiil 
age should be related to other findings on the rate of growth of the mental 
functions. The primary factors should preferably be a .set of parameters 
which can be identified at each age by appropriate tests. The acceptance of 
primary factors in psychological investigation will depend on the extent 

+ non-factorial psychological research. If they 

represent truly significant parametera for the description of mental friits 
ttey should »l.o b. rovealed uo d»tl„B„W,ublo L IWuTy Si 
mheritance. It is to be hoped that at least some of the primary Ltors 
aie now being identified m the study of individual differences at point age 

be ngeful and simplifying pttranioter.s in the study of 
mental inhentaneo and m the study of mental growth, ^ 

Uniqueness of simple structure in a given correlation matrix 

When reference axes have been found which produce a simple structure 

^nnTt- ^ correlation matrix. The necessary and sufficient 

thelbiT a simple .structure need to be investigated. In 

]• t ^ s. ‘Jomplete solution to this problem, five criteria will here be 

listed which probably constitute sufficient conditions for the uniqueness of a 
^ple structure. The scientific interpretation of the ce 1 ” 

SatL interpretation shoufd be 

onfcarehmiltt^f ‘-T ■" structure, 

Xh W com nl T ^S'^rds the uniqueness, those tests 

figurattra^^^^^ T; ‘“^ts are in the middle of the con- 

At th^sM S contribute to the location of tho reference frame. 

zero coSmLIlff T eliminated which have 

raffish^riv si f’.? M r*!? correlations are all 

tiorof Sw, ; fcan be eliminated from considera- 

eZlZ at 11 1' Z have not been 

mmated at the start because of their low correlations. In practice, one 
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need only eliminate from consideration those tests in the oblique factor 
matrix which have complexity r, because the other eliminations are made 
routinely in factoring the correlation matrix to save the unnecessary labor 
of carrying some tests through the factoring when they cannot contribute 
to the analysis. 

If we eliminate the tests of complexity r, the remaining testa should con¬ 
tribute to the location of the reference frame. We shall describe five useful 
criteria by which the r reference vectors can be determined. These are as 
follows: 

1) Each row of the oblique factor matrix V should have at least one zero. 

2) For each column p of the factor matrix V there should be a distinct 
set of V linearly independent tests whose factor loadings v^p are zero. 

3) For every pair of columns of Y there should be several tests whose 
entries Vjp vanish in one column but not in the other. 

4) For every pair of columns of F, a large proportion of the testa should 
have zero entries in both columns. This applies to factor problems with 
four or five or more common factors. 

5) For every pair of columns thei'e should preferably be only a small 
number of tests with non-vanishing entries in both columns. 

When these conditions are satisfied, the plot of each pair of columns 
shows (1) a large concentration of points in two radial streaks, (2) a large 
number of points at or near the origin, and (3) only a small number of 
points off the two radial streaks. For a configuration of r dimensions there 
are 1) diagrams. When all of them satisfy the thi’ee characteristics, 
we say that the structure is “compelling,’'’ and we have good assurance 
that the simple structure is unique. In the last analysis it is the appearance 
of the diagrams that determines, more than any other criterion, which of 
the hyperplanes of the simple structure are convincing and whether the 
whole configuration is to be accepted as stable and ready for interpreta¬ 
tion.* 

The first criteiion demands that each trait should be describable in terms 
of fewer categories than are required by the whole set of n traits. It is con¬ 
ceivable that, in some experimental work, one or more of the traits will be 
so complex as to require description in terms of all the factors that enter into 
the traits collectively. For the purpose of isolating the fundamental cate¬ 
gories, these traits are not useful, and they should therefore he ignored. 
The criterion demands that the list of traits be long enough so that, after 
elimination of several traits of complexity r, enough traits of complexity 
less than r remain to determine uniquely both the trait configuration and 
the simple structure. This principle may be illustrated with psychological 

* Ever since I found the simple-structure solution for the factor problem, I have never 
attempted interpretation of a factorial result without first inspecting the diagrams. 
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tests. If one of the abilities to be isolated should be number sense, then this 
primary ability should not be required in all the teats of a battery. The 
same restriction applies to each of the abilities that is to be isolated. 

The second criterion seems to be essential for the following reason Each 
column p of V is determined by a hyporplane L,. A hyperplane through 
the origin IS determined by (r-1) trait vectors. These trait vectors L 
rantamed in Lp, and therefore they have vanishing entries vj, in column v 
Therefore, there must be at least (r-1) traits with vanishing entries iii 
each column of 7 in order that the hyperplanes may be determined. Since 
the hyperplanes should be overdetermined by the data, it follows that the 
number of vanishing entries in each column of V should equal or exceed r 
The third criterion is suggested by the fact that the r hyperplanes must 
be distinct If two columns of 7 contain the same vanishing entries and if 
these exceed (r-2) in number, then, assuming the test vectors to be linearly 
independent, the two corresponding hyperplanes are identical. The third 
criterion was written so as to insure both overdetermination and distinct¬ 
ness of the hyperplanes that define the columns of 7. 

When the fourth criterion is not satisfied, i.e., when there are no points 
at or near the origin for a problem of more than four or five dimensions, we 
can bo reasonably sure that the hyperplanes have not been correctly located 
This has been our experience with large and small factor problems. The 
fourth criterion is of importance in factor problems of four or more dimen¬ 
sions. In a tliree^imensional problem a point at the origin on the diagram 
for factors 1 and 2 would have to bo a measure of only the third common fac¬ 
tor, so that its complexity would be 1. In two dimensions there can be no 
points at the ongin except for a null vector. Such a vector is not found in a 
factor problem because its correlations would all be zero or small so that it 
would be ehminated from the test battery before factoring was begun. 

i he problem of determining the uniqueness of a simple structure may not 
be so serious as it seems at first sight. We are accustomed to the demand of 
statistical methods that a solution shaU be unique in order to be classified 
^ method. Actually, we do not often attain uniqueness. The 

Zthtl Z unique even when the same 

methods are used, as, for example, when a least-squares solution gives sev- 

Phnnl ‘depending on which of the variables the investigator 

the rest of the variables. However, it would be 
loSd Sow h ^ simple-structure problem by which we 

configuration that gives a better fit than the one we may have found 

structure as a solution to a factor problem, several 
considerations deterimne the plausibility and acceptability of the solution. 



THE SIMPLE-STRUCTURE CONCEPT 337 

The plausibility of a solution, should be considered separately for each fac¬ 
tor. Some of the relevant criteria will be mentioned briefly: 

1) The degree of ambiguity or plausibility of each hyperplane as judged 
by the configuration. In Figure 5 we have illustrated for a three- 
dimensional configuration how the several co-ordinate planes frequently 
differ widely in degree of plausibility and convincingness. The plane Li is 
overdetermined by more than enough points (test vectors) to define the 
plane, and hence the existence of a parameter T\ seems clearly indicated, 
The plane La is barely determined, since two points are the least that will 
define the plane in three dimensions. The existence of the parameter Tt is 
suggested but not demonstrated. The plane La is indeterminate, as shown 
by several possible locations in the dotted lines. The parameter Ta is sug¬ 
gested but not demonstrated. In Figure 6 we have a three-dimensional con¬ 
figuration of six test vectors, in which the structure is not at all convincing. 




The sets of solid lines and dotted lines show two entirely different simple 
structures, neither of which is overdetermined. We see here how it is not 
likely that some single criterion will be found for the uniqueness of a simple 
structure, because the several planes and their corresponding parameters 
may differ widely in their, degree of overdetermination and convincingness 
in any particular factor study. 

2) The plausibility of the theoretical interpretation that the investigator 
may be able to find for each hyperplane. When an unexpected plane ap¬ 
pears in a factorial study, it is a challenge to find an interpretation for it. 
If the interpretation seems plausible and if it clearly divides the tests into 
two categories, those with strong non-vanishing values of Yjp and those 
with negligible factor loadings, the interpretation can be accepted at least 
as a hypothesis worthy of further study. This task of interpreting the fac¬ 
tors found is clearly the most important part of a factorial study. If the 
interpretation is foggy, then so is the whole study, no matter how elegant 
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the statistical work may have been. Exploratory studies in a new domain 
are likely to give clues only as to the nature of the underlying functions or 
parameters. 

3) The predictability of a postulated factor. In order to set up a crucial 
test of the word fluency factor W, two new tests of synonyms were con¬ 
structed, one of which was predicted to have high saturation on W and no 
saturation on the verbal factor V, while the other synonyms teat was pre¬ 
dicted to behave in just the opposite way, namely, zero on word fluency 
W and high on the verbal factor V. They did behave in the way predicted 
in the next factorial study. This did not prove the interpretation of W to be 
finally correct, but it did sustain the hypothesis concerning the differentia¬ 
tion of V and W. Eventually, the factor W may be redefined by other 
studies so that it might even transcend the verbal content altogether. 
Here, as in other experimentation, success depends very largely on how suc¬ 
cessful we may be in inventing tests and measurements that will be crucial 
in differentiating between rival hypotheses concerning the nature of the 
factors or in testing a tentative interpretation indicated by previous studies. 
It may happen that one experimenter will find a factor, that another will 
interpret it with some hypothesis, and that a third will invent the crucial 
teats by which the hypothesis can be examined factorially or otherwise. 
It is in this manner that factor analysis can find an important role as a 
scientific method not only in psychology but in other sciences in which ex- 
ploratoi-y studies may reveal an underlying order in a new domain. 

In making interpretations for a new factor that has been identified fac¬ 
torially, we distinguish, in the spontaneity of our approval, between inter¬ 
pretations that seem vague or far-fetched and those occasional incisive in¬ 
terpretations that “click,” as it were, and by which the factorial results 
snap into a meaningful whole. This is only to say that the scientific inter¬ 
pretation of experiments is as subjective now as it always has been. To de¬ 
mand that factorial interpretation shall be objective is as absurd as to de¬ 
mand that the interpretation of a physical experiment shall be objective. 
It never is. 

4) The degree of convincingness of a simple structure. This has been 
described as due, in part, to the overdetermination of each hyporplane, but 
this judgment is made also with due regard to the relative number of test 
vectors that do not contribute to define the simple structure. In Figure 7 
we have drawn two plots that might be found for a pair of columns of a 
factor matrix. In the first we could fit the planes anywhere in a random 
configuration with perhaps enough points to determine a hyperplane, but 
it would not be convincing. In the second plot we should feel quite con¬ 
vinced that an underlying order is revealed because the distribution of the 
points makes the location of the two axes quite compelling. Here mm judg¬ 
ment is influenced by the relative number of points that do not contribute 
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to the definition of the simple structure. In the second plot we have drawn 
several points in the middle of the first quadrant. If an intei’pretation can 
be found for the factors A and B, then it is necessary to explain how it 
comes about that the several testa in the first quadrant have some satura¬ 
tion in both A and B. If such an explanation seems plausible, it strengthens 
the interpretation of the factors. A configuration such as the first in Fig¬ 
ure 7 leaves one unconvinced, no matter where the axes are drawn, unlesa 
an interpetation can be found that seems right. Random configurations like 
this seldom yield clear interpretations, but they are not, of course, physical¬ 
ly impossible. 
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Some critics have pointed out that if the factorial composition is known 
for a large test battery, it would be possible to pick and choose a set of 
testa from the larger battery so that they would reveal a simple structure 
even for some more or less arbitrarily selected reference frame and that the 
simple structure so put together would not demonstrate any validity for 
the arbitrary reference frame. This is entirely correct. This is only one of 
many ways in which a dishonest author can fake scientific data. Another 
well-known case is that in which one can pick and choose points in a corre¬ 
lation table, erasing the points in the second and fourth quadrants, so as to 
change a zero correlation to a high positive value. If a test battery is as¬ 
sembled with tests that are crucial for one or several rival hypotheses, the 
configuration of the whole battery should be used in the interpretation. If 
the interpretation is valid, it should be possible to construct new and differ¬ 
ent tests with prediction as to how they should behave factorially. Again 
we should want to see the hypotheses, the tests, and the whole configuration. 
Another criticism of simple structure which is in the same class is that 
one gets factorially only what one puts into a test battery and hence that 
the separate factors have no validity and represent only the arbitrary cate¬ 
gories imposed by an author. It is a platitude to say that one gets out of a 
test battery only what one puts into it. Again, that is true for any scientific 



340 


MULTIPLE-FACTOR ANALYSIS 


ejjpfenment. When a test battery is constructed with some hypothesis 
which IS to be examined, it does not follow that the factorial analysis neces¬ 
sarily supports the categories that guided the construction of the batterv 
Most of our disappointments in factorial studies are, in fact, exactly of this 
kind. Hence we can say on the basis of considerable experience that a factor 
analysis does not necessaiily reproduce the categories that constitute the 
preconceptions of the investigator. Any factors that are found are certainly 
represented by the tests that were put into the battery, but they do not 
necessarily fit the preconceptions of the experimenter. 

The various criteria that have been discussed hero seem obvious enoueh 
when we deal with graphical methods of inspecting the configuration, but 
they are likely to prove troublesome for anyone who attempts to reduce 
them all in some algebraic manner to a single criterion of uniqueness of 
siinple structure. Any contributions in this direction ai-e likely to be helpful 
in deahng with partial aspects of the problem of finding the most plausible 
reference frame for any given configuration. It must not be forgotten that 
It IS an open question for each factorial study whether any simple structure 
e^ts at all or whether any one or several hyperplanes can be defined. It 
should also be noted that a factor study may be a major scientific contribu¬ 
tion If it reveals only a single clear factor which can be given a fruitful and 
provocative interpretation, even if aU the other factors in the same study 
prove ^ be entirely indeterrninate. Furthermore, such a factorial result 
might be of fundamental significance, even if, say, only a fourth or a third 
of ^e variance of the crucial tests is accounted for by the factor in question. 
Other things being equal, a factor will be the more convincing, the higher 
the saturations involved in the tests that involve the factor. But the erist- 
ence of large parts of the variance as unique or as uninterpreted common 
factors does not preclude significant findings. 

Factorial studies may be roughly classified as of two kinds. When there 
are no hypotheses to guide the study of a new domain, the experimenter 
tnes to cover the domain with tests or measures that are diversified within 

Sr. «likely to give an incomplete simple struc- 

tme at best, but the exploratory study is justified if one or more functions 
or par^eters appear in the interpretation that can be used as starting- 

V r e'^bsequent studies. The second kind is the experi¬ 
ment in which some hypotheses are available and in which tests are specially 
tnr to represent the presence and the absence of each postulated fac- 

results^ P^^'l’Tctive of definitive 

Interpretation of zero factor loadings 

°°°^lonal misunderstanding about the interpretation of zero 
r oa ngs. zero factor loading in a test is sometimes spoken of as 
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if it meant the absence of the factor in the test, but that is not the correct 
interpretation. A zero factor loading means that the factor in question 
does not contribute to the vo/nancc of the test. The difference can be seen by 
an example. Consider two hypothetical factors, spelling and writing speed. 
If a simple spelling test were given by the time-limit method to a group of 
educated adults, the number of right answers might represent nothing but 
speed of writing, because the educated adults could be assumed to be able 
to spell all the simple words. Hence the variance of this test would be at¬ 
tributable entirely to writing speed and none to spelling ability. But it 
would be incorrect, strictly speaking, to say that the test does not involve 
any spelling ability. If the subjects were all equally good in a factor or if 
they all reach the ceiling of the test as regards power, the factor would not 
be responsible for any individual differences in the test, and the factor 
would not be identified. 

If a spelling test of greater difficulty were given to the same population 
with ample writing time, then the factorial composition would be markedly 
changed. The greater part of the variance might then be attributable to 
the spelling factor, while the loading on writing speed would be zero. The 
zero loading on writing speed would be caused by the fact that this factor 
contributed nothing to the variance of the test, even though all the sub¬ 
jects actually wrote the test. 

In the interpretation of zero factor loadings we sometimes say that the 
factor is not involved in the test when we really should say that the factor 
is not involved in the test variance. Since we deal mostly with common fac¬ 
tors, we speak of the factors in a test when common factors are implied. 

The positive manifold 

The principle of simple structure is frequently described as if it assumed 
all factor loadings to be positive or zero. That is perhaps the most common 
misunderstanding about the principle. The reason is probably that the fac¬ 
torial methods have been applied more in the field of mental abilities than 
in any other field, and it is here that test correlations have been found uni¬ 
versally to be positive or zero. It is therefore natural to postulate that 
when a unique simple structure is found for a battery of tests of mental 
abilities, then the non-vanishing entries in the factorial matrix are positive. 
But it must be understood that this is a postulate of much psychological 
investigation in a particular field and that it does not constitute a restriction 
upon the principle of simple structure, which is applicable either with or 
without the special restriction that the factor loadings shall be positive or 
zero. 

The scientific problems to which the factor methods are applied may re¬ 
quire different restrictions on the elements of the factorial matrix. Some 
of these restrictions may be considered under four cases, as follows: 
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1) The simplest case is that in which the factorial matrix F can be used 
as determined by the centroid method, or by any other equivalent method, 
without restrictions beyond those that are inherent in F. It is probably 
seldom that a scientific problem can be adequately solved without some re¬ 
strictions on the elements of F. 

2) One form of constraint that is of very general scientific interest as re¬ 
gards the factorial matrix is that of simple structure. 

3) If the scientific problem is such that negative cell entries in F are ex¬ 
cluded, then we have the important case of a simple structure in which 
OjmSO. This is the assumption that underlies the application of factorial 
methods to the problem of isolating primary mental abilities; but the as¬ 
sumption is not absolutely necessary, since ideal constructs can be devised 
for a science of psychology which do not require that the cell entries of F, 
or those of the oblique factorial matrix V, be positive or zero. 

4) A special case of the positive entries of F is the further restriction that 
each factor of F or of Y he either completely present or completely absent 
in each test. This is a case of possible interest in genetics, but it is not likely 
that it will be directly applicable to scientific data without admitting a spe¬ 
cific variance for each variable. 

If all the elements of V are positive or zero, then each column of V is de¬ 
fined by a positive hyperplme so located that all the trait vectors which are 
not contained in it are on the same side of it. If it is assumed that all the 
factors have positive or zero contributions to each variable, then all the 
trait vectoi’s are in the positive region. The bounding planes of this region 
are then of special interest. 

It will be convenient to name the bounded space within which any radial 
vector has only positive direction cosines. The bounded space in which any 
radial vector has only positive direction cosines will be called the positive 
region. 

If all the trait vectors that do not lie in a hyperplane are on the same side 
of it, the hyperplaue will be called a positive hyperplane with reference to the 
trait configuration. 

If, in addition, a set of r positive hyperplanes exists such that each trait 
vector is contained in one or more of them, then the combined configura¬ 
tion of the trait vectors and the reference vectors will be called a positive 
simple structure. 

The geometrical interpretation of the restriction upon the numerical val¬ 
ue of Vjp in V in the case of mental ability tests is that all the test vectors 
lie in the positive region of the common-factor space. When this condition 
is satisfied for orthogonal vectors, all the intertest correlations are positive 
or zero. It is a universally accepted fact that intertest correlations for men¬ 
tal abilities are positive. 

The converse is not necessarily valid. The well-known fact that all inter- 
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test correlations are positive implies that all the test vectors lie insirlA a cone 
vrith center at the origin and with a generating angle of 7r/4. Such a cone 
cannot be inscribed in the positive region except when the number of di¬ 
mensions is as low as two. 

The restriction that all the test vectors shall be in the positive region of 
the common-factor space is not sufficient to determine F uniquely. In gen¬ 
eral, there exists an inhnite number of orthogonal transformations by which 
all the entries in F become positive or zero if the configuration of P can be 
inscribed in the positive region. Special cases may be set up in which one, 
and only one, orthogonal transformation will make the entries a/*, in F posi¬ 
tive or zero. Such a case in three dimensions is that in which three test vec¬ 
tors are mutually orthogonal. These cases are not likely to be found in 
practice. Hence a unique matrix F is not to be expected with the single cri¬ 
terion that 0 in F. 

The orthogonal hyperplanes which bound the positive region in r dimen¬ 
sions will be called the orthogonal positive manifold. 

A set of r distinct and oblique positive hyperplanes for a trait configura¬ 
tion in r dimensions will be called an oblique positive manifold. 

If the factor matrix of the traits which are contained in a positive hyper¬ 
plane is of rank (r —1), then the hyperplane is a bounding hyperplane or a 
positive co-ordinate hyperplane. 

The identification of a positive simple structure is done by noting the 
bounding hyperplanes if they are found in the rotations. If a positive mani¬ 
fold is not postulated or suspected in the test battery, the rotations are 
made toward linear concentrations of test points in the diagrams without 
reference to the question of whether the hyperplanes are bounding planes. 

Unitary factors 

A special case of the positive manifold is that in which each factor is 
either completely present or entirely absent in each member of the experi¬ 
mental population. Each individual member of the population has, then, 
one of only two possible standard scores—one positive, which represents the 
presence of the trait, and the other negative, which represents the complete 
absence of the trait. The numerical values of these two possible standard 
scores are determined by the proportion of the population that has the 
trait. If it is assumed in first approximation that the unitary factors are 
equally weighted, then the correlations take only certain possible values 
which are determined by the number of the unitary factors or elements in 
each of the test variables. By inspecting the experimental correlations, one 
can make estimates of the number of elements in each test variable. This 
method of factor analysis seems to be limited in practical application be¬ 
cause of the serious effects of unique variance and because the elements are 
not likely to be equally weighted in each test variable. However, the restric- 
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tion of the correlation coefficients to certain values makes this principle of 
some theoretical interest, and it might be adapted to factorial studies of cer¬ 
tain types. It can be regarded as a different type of restriction on the fac¬ 
torial composition by which the reference axes may be located. This method 
has not yet found practical application.* 

Constellations 

In formulating hypotheses concerning the nature of the primary traits, 
it is sometimes a considerable aid to know of constellations that may exist 
in the trait configuration. By a constellation is meant a grouping of trait 
vectors. It happens not infrequently that the trait configuration consists 
essentially of groups of trait vectors. The angular' separations between the 
trait vector's within a constellation are relatively small, while the separa¬ 
tions between constellations are marked. 

When the dimensionality of the factorial matrix is less than four, the con¬ 
stellations may be inspected readily by graphical methods. When the di¬ 
mensionality exceeds three, the graphical methods are not available, and it 
is then useful to have a routine by which the constellations may be isolated 
in the trait configuration, f Since the constellations are to be used os an aid 
to intuition regarding the nature of the primary traits, it is not advisable to 
define a constellation rigorously as regards maximum angular separations 
or as regards the maximum generating angle of the cone which will include 
a constellation. Such restrictions may be arbitrarily imposed by the in¬ 
vestigator for each study. 

If an attempt is made to isolate constellations from a large battery of 
traits—say, fifty or more—without some systematic procedure, it is usually 
found that the groupings become entangled in annoying complexity. If the 
constellations do not exist, the procedure must make this fact evident; but, 
on the other hand, constellations can be drawn for the purposes of studying 
the battery, even though the traits arrange themselves more in the nature 
of chains than of constellations. In three dimensions this situation is illus¬ 
trated by a battery of traits whose configuration reveals a spherical triangle, 
in which the sides of the triangle are well defined by the trait vectors. If all 
of them lie in the sides of a spherical triangle, then the isolation of constella¬ 
tions would be difficult, because there may be no sharp break between one 
constellation and the next. In three dimensions the graphical methods 
would, of course, be used because of their simplicity and directness; but in 
higher dimensions the groupings may be obtained by inspectional methods 
from the intercorrelations corrected for uniqueness, t 

* See first ed., pp. 205-12. t See first ed., p. 174. 

t Lately, Professor Tryon has proposed that we return to cluster analysis instead of 
the factorial methods that have been developed in the last decade. The inspection of 
a correlation matrix for groupings or clusters was naturally the first attempt in onalys- 
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One useful procedure is to ascertain, first, the average correlation in each 
column of the correlational matrix Ru, where the given coefficients have been 
corrected for uniqueness. (An alternative is to count in each column the 
number of coefficients whose absolute values exceed some specified values.) 
Select the trait T g with highest mean coefficient. List all the traits whose 
correlations with Tg exceed the specified value and complete the correla¬ 
tion matrix for the traits so selected. Eliminate from the table the trait 
which has the largest number of small intercorrelations. Repeat the elimi¬ 
nating process until all the traits that remain in the table have appreciable 
intercorrelations. These traits constitute a constellation. Select the trait 
whose mean coefficient is next highest and which is not listed in the group 
just formed, and proceed with it in the same manner as with Tx until the 
majority of the traits have been assigned. These groupings are flexible, and 
they may be arranged to overlap. The arrangement of the traits in constel¬ 
lations should be regarded merely as a rough method of inspectional anal¬ 
ysis. The procedure here outlined can, of course, be modified in many ways. 

A note about static and dynamic factors 

Investigators who are using the factorial methods as an aid in testing 
psychological hypotheses find themselves involved not only in legitimate 
controversies about techniques and about interpretation with rival hypothe¬ 
ses but also in some forms of criticism that are not much more than verbal¬ 
isms. One of these that recurs too frequently is the charge that differenti¬ 
able functions or parameters that can be identified factorially are invalid be¬ 
cause they are supposed to be static, mechanical, atomistic, and isolated 
and that any such factors imply behavioral anarchism. In contrast, we are 
told that factors, instead of being static, must be functional and dynamic 
“relationships” and that these must somehow embrace the whole personal¬ 
ity. It is doubtful whether any real issue exists to justify such talk. It is 
doubtful whether any psychologist who has good training in his subject 
ever really looks for a factor that is truly isolated from the rest of man’s 
mind. Further, if a factor is a relation of some kind, then surely there must 
be some distinguishable things that are related; and if these things are not 
to be identified, then the relation will be obscure indeed. 

In the box problem one of the factors was the height. That was a param¬ 
eter that entered into the measurements of each box, but it does not fol¬ 
low that the height was in any sense isolated from the totality of the box. 
But to this example there would be the objection that the boxes and their 
measurements are static, whereas in psychology we must be dynamic. In¬ 
stead of using boxes as an example, we could have used flywheels. This ex- 

ing the correlations. The early inspectional methods for clusters are hardly to be pre¬ 
ferred to the factorial methods, which Identify not only the clusters but also groupings in 
hyperplanes. 
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ample would have shown dynamic factors, such as momentum thp . 
of gyration and revolutions per second of the flywheels. Such kJ exS® 
would work just as well in differentiating between factors which woSi' 
refer to kinetic aspects of the objects. Factor analysis would annlv 
in one case as in the other. Pedagogically it is perhaps better use The 

boxes because the reader can then devote himself to factorial ideas instead 
of tiymg also at he same time to learn some theoretical mechantl 
Another verbahsm in the interpretation of factors is the insistence that 
th y must be treated as “relationships.-' Let us not talk aZt re^ 
Without giving at least some hint about the entities that are beZ Sted 
Helations do not float around by themaeJvpq Tl-imr i a j-l * 
or things that am minted. In Ze « taLZ 
™tion is aimilariy described .8 eonahting of "Lntiljnshim 
t^re«enit„en,dbei„te^.„gl.,n“^ 
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OBLIQUE STRUCTURE 


Primary trait vectors 

The fundamental concepts of oblique structure will be here defined for r 
dimensions, 1 has been drawn to show the relations of the reference 

vectora Ap, the hyperplanes Lp, and the primary vectors Tp. Figure S has 
been drawn to show these relations in rectangular form. 

In Figure S we have the factor matrix F with elements a,-™, which are de¬ 
termined by the factoring process from the correlation matrix. The trans¬ 
formation matrix A with elements \mp carries the factor matrix F into the 
oblique factor matrix V with elements «/p. This is expressed in the equation 

( 1 ) FA^V. 

The test vectors i are defined in F by their projections on a set of orthog¬ 
onal reference axes. The same test vectors are defined in V by their 
projections on a set of oblique reference axes Ap. In Figure 1 the oblique ref¬ 
erence axes Ap are shown, but not the orthogonal reference frame. Each 
column of the transformation matrix A gives the direction cosines of one 
of the reference vectors in terms of the orthogonal frame. 

The r hyperplanes, whose normals produce a simple structure with a test 
configuration, will be called the co-ordinate hyperplanes for the test configu¬ 
ration. The simple structure is defined by the test configuration and the nor¬ 
mals Ap to the co-ordinate hyperplanes Lp. In Figure 1 each reference vector 
Ap is orthogonal to the hyperplane Lp. In particular, the reference vector 
Ai is orthogonal to the hyperplane Li, and similarly for the other planes. 
The reference vector defines the hyperplane, which is a subspace of (r—1) 
dimensions in the total common-factor space of r dimensions. 

The intersection of any set of (r— 1) co-ordinate hyperplanes defines a 
co-ordinate axis of the structure. In Figure 1 the intersection of the hyper- 
planes Li and L^ defines the co-ordinate axis Tt. The total number of sets 
of (r—1) hyperplanes that can be taken is r, and consequently their inter¬ 
sections define r co-ordinate axes. These are of scientific interest because 
they define the descriptive categories of the simple order in terms of the 
tests. 

The test vectors that lie in the hyperplane Li are orthogonal to the refer¬ 
ence vector Ai, and hence these tests have zero projection on that reference 
vector. In Figure 2 these tests are identified by zero projections Vji in the 
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column 1 of the oblique factor matrix V. Each of these projections is deter¬ 
mined by the cross product of a row of F and the first column of A. 

The unit vector defined by a co-ordinate axis will be called a primarv 
trait vector or a primary vector. The tiuit which corresponds to a primary 
vector will be called a primary trait or a primary factor. The object of a fac¬ 
torial analysis is to discover the primary traits and to describe them in terms 



Fiavim 1 


tr T ^ observed. In Figure 1 it is seen that the 

The subscHr/ ^ T ^ intersection of hyperplanes U and U. 
The subscript for each primary vector is identical with that of the hyper- 

E X ™ primaiy factor. Each primary vector T, 

InthZd" intersection of the (r-1) hyperplanes L„ where 
Thi! w dimensions there are three planes L, which contain the ori¬ 
gin. 1 heir mtersections determine the primary vectors Tj,. 
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The intersection of all the co-ordinate liyperplanes, excepting L^, defines 
a primary ti;ait vector, which is denoted T,. Hence T, defines the linear 
subspace which is comftion to all the hyperplanes, excepting Lp The trait 
vector Tp is not contained in the hyperplane L^, but it is contained in all the 
other hyperplanes. It follows that in Figure ® the primary trait is absent 
in all the tests which have vanishing entries Vjp in column p of 7 The pri¬ 
mary trait Tp is present in all tests that have non-vanishing entoies Vj in 
column p of 7. ^ 


m 



Figube 2 


Since the primary trait vector Tj, is not contained in the hyperplane Lp, 
it might be inferred that it is identical with the normal to the hyperplane 
Ijp. This is not necessarily the case. If the primary traits are uncorrelated 
in the experimental population, then the vectors Tp are orthogonal, and so 
are also the co-ordinate hyperplanes Lp and their normals Ap. In this case 
the reference vectors Ap are identical with the primary vectors T,. How¬ 
ever, if the primary traits Tp are correlated in the experimental population, 
then the hyperplanes Lp are oblique, and their normals Ap are oblique. The 
two sets of vectors Ap and Tp are then, in general, distinct. 

The geometrical interpretation of primary traits may be illustrated in 
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three dimensions. Lot the entries a,„, in each row of F be augmented by the 
multiplier l/hj. The geometric representation of the augmented co-ordi¬ 
nates is that each test vector is extended to unit length. The augmented 
co-ordinates are therefore the direction cosines of unit test vectors. The 
termini of the test vectors can bo represented as points on the surface of a 
hypersphere. If r=3, the teat configuration can be .studied graphically on 
the surface of a ball. 

Let Figure 3 represent the test configuration, and let the points represent 
the termini of the test vectors on the surface of the sphere. Simple structure' 
is shown by the fact that each point lies in one of the three arcs of great cir¬ 
cles. All the tests on the arc 1-2 can be described by two primary factors, 
since all the corresponding test vectors are coplanar. The whole set of tests 
can be described by three factor's. Hence the same primary f aiitor is absent 



in all the tests along 1-2. The subspace 1-2 is defined by the direction co¬ 
sines of the normal to the plane 1-2. Lot this normal be denoted As. The 
subscript of A> refers to the primary trait Tj, that is absent in the subspace 
La. The vector Aa is the normal which defines the subspace La. 

By analogy, the vector Ai is the normal to the plane 2-3, and Aa is the 
normal to the plane 1-3. If all test vectors in the plane 1-2 represent two 
primary factors and if all test vectors in the plane 1-3 represent two primary 
factors, it is clear that the vector which is determined by the intersection of 
these two planes represents the primary factor wliich the two planes have in 
common, namely, the primary factor 1. In the same manner the other pri¬ 
mary factors, 2 and 3, are determined by intersections of planes. 

Equation (1) is shown in rectangular notation in Figure 2. The equation 
can be written in terms of its elements, 



(2) 
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In Figure 2 let the rows of a matrix T with elements represent a set 
of r primary unit vectors Tp. The rows of the square matrix T are normal¬ 
ized, since Tp are unit vectors. These are the vectors Ti, T^, and T 3 of 
Figure 1, and they are defined as intersections of the planes Lp. The direc¬ 
tion cosines of the first primary vector, the first row of T, are in, ha, ha. 
The direction cosines of the normal to the plane La, the second column of A, 
are Xia, X 22 , Xsa. Since the vector Ti lies in the plane La, we should have 

(3) iiiXia -(- tia\aa "h LaXsa = 0 . 

In a similar manner, since the vector Ti also lies in the plane La, we have 

( 4 ) tiiXia {12X23 {13X33 = 0 . 

A similar substitution of the direction cosines of Ti in the equation of plane 
Li gives 

(5) {iiXii -t- { 12 X 21 -|- { 13 X 31 = di, 

which should not vanish, since the vector Ti does not lie in the plane Li. 
Let the constant term be denoted di. These three equations are, in fact, the 
multiplication of the first row of T and the three columns of A, with prod¬ 
ucts recorded in the first row of the diagonal matrix D, as shown in Figure 
2. The other rows of T can be regarded in a similar manner, so that we have 
the matrix equation 

(6) TA = D, 

where Z? is a diagonal matrix with diagonal elements dp. Hence we get 

(7) r = DA-i, 

by which the numerical values of T may be determined. The inverse of A 
is normalized by rows to give T. 

The matrix T is placed in Figure 2 as & continuation of the factor matrix 
F. Each row of T can be regarded as if it represented a perfect test j of one 
of the primary factors, each of these tests being of unit communality. After 
the transformation A, each of these tests will have unit complexity in the 
oblique factor matrix V, in that there is only one entry dp in each row of 
the corresponding section of V, namely, the diagonal matrix D. 

The correlations between the primary factors, Rp„ can be found by the 
fundamental factor theorem, since T is a factor matrix for the primary 
abilities. We then have 


(8) 


Rp, = TT ', 
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or, by (7), 

(9) Rp, = DAr^iPK-^y , 

which can be written in the form 

(10) = I>A-‘(A-i)'r) ; 
and this can be expressed as 

(11) Rp, = I)(A'A)-iU. 

Equation (11) can be used to find the correlation between the primary fac¬ 
tors directly from A and without writing T explicitly. The matrix multipli¬ 
cation (A'A) is first performed, then the inverse is found, namely, (A'A)-‘, 
The coluMS and rows are adjusted by premultiplication and postmultipli¬ 
cation with the same diagonal matrix D to make the diagonal entries of R 
unity. Let the diagonal entry of (A'A)-* be Then the corresponding 
diagonal entry of I) is 



Since the derived pure tests T of the primary factors have unit communal- 
ity, the self-correlations must be unity. 

Each diagonal element dp is the scalar product of the primary vector T, 
and the corresponding reference vector A,. Since both of these vectors are 
unit vectors, the diagonal element dp is the cosine of the angular separation 
of the primary vector Tp and the corresponding reference vector A,. We 
then have 

tgm'Kmp where q = p , 


which becomes unity in the orthogonal case where Tp and A, are identical. 

In case we have an orthogonal simple structure, the reference frame of V 
13 also orthogonal. Then the transformation A in (1) is an orthogonal trans¬ 
formation so that A-»=A'. Then in (11) A'A=A-iA=7. Then, by (11), 
we have Rpq—I, as would be expected. 

Test vectors as Unear combinations of primary vectors 

So fM we have considered the teat vectors in terms of the fixed orthogonal 
frame (a/„ m F) and the primary vectors in terms of the same frame, 
m e pnmaiy factor matrix T, as shown in Figure 2. Consider again the 
test vectors which lie in the co-ordinate planes of Figure S, and the primary 



OBLIQUE STRUCTUEE 353 

factors 1, 2, and S at the corners of the configuration. The test vectors in 
the plane 1—2, for example, can be expressed as linear combinations of the 
primary vectors Ti and Ti. We should then have 

( 1 ®) = djm I 

P 

in which Ajp is the weight given to the primary vector p in the description 
of test vector j. This equation can be written in the matrix form 

(14) AT = F , 

and hence the desired weights in A are 

(15) A = FT -^; 

but by (7) we have 

(16) A = i?’(I)A-i)-i, 
which becomes 

(17) A = FAD-‘. 

By (1) we have 

(18) A = VD-^, 

from which we infer that the weights by which the test vectors j can be ex¬ 
pressed as linear combinations of the primary factors T are proportional by 
columns to the entries in the oblique factor matrix V. "V^en tbe trans¬ 
formation A becomes known by rotational analysis, the proportionality con¬ 
stants of D are the reciprocals of the diagonal entries in equation (12). 

The test correlations in terms of the primary vectors 

Since the test vectors can be expressed as linear combinations of the pri¬ 
mary vectors, the test correlations ry* can also be expressed in terms of the 
primaries. By the fundamental factor theorem for orthogonal factors we 
have 


Rjk = FF', 


(19) 

and by (14) we get 

( 20 ) 


Byfc = ATiAT)' 
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which, by (8), becomcK 


Rik = ATT'A', 


lisk - AR^,A' , 


where ijp, IS the matrix of correlations between tlie primary factors. Equa 
tion (22) 1 .S Tuckers generalization of the fiindumental factor theorem to 
the general oblique case.* The matrix A k proportional by columns to the 
Oblique factor inatrix V, as m equation (18). If the primary factors are un- 
coiieiatcd, ftp, becomes the identity inatrix, .so that 


or, by (15), 


Rjt = A A' ; 


Itjk = /'T-'(/'’?’-*)'. 


tion redu^rr** <>i‘tl>ogonal nmi.rix, .so tliat ?’-*« T'. Hence the rela- 
(25) ^ 

which is the fundamental factor theorem for the cu-sc of orthogonal factors. 
The equation of an oblique simple structure 

^ liyporplano.s, all of which contain 

whosrfnPvr’'f '"“-y regarded as a degenerate cone 

whose apex is at the origin and whose surface consi.sts of the r hyperplanes. 

The equation of the hyperplaiie Lp is 

( 26 ^ l;x„x.„p = o. 

mol 

W >” dimraiMinw m«,y bo wrillcn by 

“ave''.. •” 

(27) 2^a;„Xb.2 ... Va:,„X™r =0. 

L«-i JLm=i J 
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(28) 


n 

p*i 




m=l 


= 0 . 


Fitting (28) to a given test configuration in which a simple structure is 
assumed, we have, for each tost j, 


(29) 


UjlVjt ... Vjr = 0 , 


or 


(30) 


_[ ~ 0 . 
p=l 


If the point j is in at least one of the r hyperplanes of (30), at least one of 
the r factors vanishes, and hence equation (30) is satisfied. Equation 
(28) or its equivalent, (30), is therefore satisfied by all points in the r co¬ 
ordinate hyperplanes of a simple structure. 

In order to determine the best-fitting degenerate cone for a given set of 
n points in a space of r dimensions, equation (28) may be written in the form 
of an observation equation, namely, 


(31) 


n 

p-i 




tn—1 


= P; f 


where is the discrepancy for the point The best-fitting simple structure 
may be defined as that in which 


n 


z 


P} 


is minimized, Hence the criterion for a best-fitting simple structure is the 
minimizing of 


(32) 


zn 

pal [_mBl 






}=i p-i 


The function 0 is then a criterion for the isolation of a simple structure. 

* This equation was suggested by Professor Baymond W. Barnard, of the Depait- 
ment of Mathematics at the University of Chicago. 
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Equation (32) is an example of analytical criteria for the isolation of sim¬ 
ple structure. A number of attempts have been niatle to devise practical 
computing methods with analytical criteria by which the .simple-.strurture 
solution would be obtained with fewer grnph.s than are required by tho 
methods of chapters x and .t£. Lately, .several solutions have been found that 
seem to be computationally hnusible and wliicli may replace a part of the 
graphical work. 

The population matrix 

The population matrix P„i for the common fa(.'tor.s is of order rXA'' with 
elements x^i. Each element is the .standard snore of individual i in the 
arbitrary orthogonal factor »i. In matrix form we have, for the test score sji, 

( 33 ) sji= 

m 

or 

(34) .S' = /.'/». 

By (14) wo have 

(35) ,S = ATP. 

The test scores syi can also be expro.sscd as linear combinations of scores 
on the correlated primary factors. Then 


P 

where Ajp are coefficients and Xpi are standard scores of individuals i on the 
correlated primary factors p. In matrix form* 

(37) iS' = AP., 

where Xpi are the elements of P,. By (35) and (37) we have 

( 38 ) ATP = AP,, 
so that 


(39) TP = Pp, 

where P. is the population matrix for the correlated primary factors p. 

Tuelwr, op. ciZ., p. 141. We are using notation A and P for the oblique case, corre¬ 
sponding to Tucker s generalized notation F andP. 
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The correlations between the primary factors can bo expressed in terms 
of oblique population matrix PSince x^i are standard scores, we have 

i 

or, in matrix form, 

( 41 ) Rp<i=^PcP'.. 

This equation can be related to the population matrix for the arbitrary 
orthogonal frame m. By (39) we have 

(42) Rp, = ^ {TP)iTPy 
or 

(43) P,, = i TPP'T>, 
which can be written in the form 

(44) P,, = PP') T'. 

But, since the factors in P are orthogonal by definition, we have 

(45) ^PP' = R^^ = I, 


and hence 

(46) = TT >, 

as previously demonstrated. 

The oblique observation equation 

The relations of oblique structure have been described here with refer¬ 
ence to the fixed and arbitrary orthogonal frame m. The fundamental ob¬ 
servation equation on which multiple-factor theory has been developed is 


( 33 ) 
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This is the familiar equation that we write in matrix form as 
(34) S = FP. 

Here the arbitrary factors of P arc those wliich appear in the factoring of a 
correlation matrix, and they are orthogonal. 

An observation equation (!an also be written in which the scores Sj-,- are 
expressed directly in terms (rf standard scorj's on Ihe correlated primary 
factors. This has been done by Tucker in the form 


(36) 



where Xpi is the standard score of individual i in the primary factor p and 
where oy, ai-e the test coefRcients. In matrix form wo have 

(37) S = A Pc. 

The relations of oblique structure can bo ojusily derived from (3(5) as an ob¬ 
servation equation for oblique or correlated factons. 

The correlation between testa j and k i.s 


(47) 


1 XT' 

“ jy X > 

t 


which has been written in the h.nn 


(48) li., = I, US '. 

In the same way, the correlation between the primary faclors p and q can 
be written 


(40) 


’ 


and in matrix form this becomes 


(41) lip, = ^ PcP'c . 

Substituting (37) in (48), we have 

Ri, = ^ {APcXAPcY 


(49) 



or 





By (41) we lave 


(22) I 

vlucti is the generalized laetei theom Tins hecemes 
(25) Sii=ii' = ff 


when the factors old are oithopal. 



CHAPTEE XVI 
FACTOEIAL INVARIANCE 
Nature of the problem 

The problem of factorial invariance sliould be analyzed with regard to the 
central purpose of factor analysis, the object of which is to discover a set of 
significant and meaningful parameters for describing a domain. In the box 
problem that we have found useful for illustrative purposes, the domain is 
the whole range of measurements which can be taken on rectangular boxes 
and which are functions merely of the sliapes of the boxes. We have found 
that one simplifying set of parameters for this domain is the lengths of three 
adj^ent edg^, denoted a:, y. and 2 , for the height, the length, and the 
width, respectively. Now let one of the measurements sy be determined in 
large part by the height, a:, and let it be assumed that in a random collection 
for analysis, there is marked variance in this parameter, 
the height. It would then be expected that the measurement sy would have 
a certain part of its variance, a^, attributable to the height factor in this 
coliection of boxes This is simply the square of the factor loading of the 

in nrder from lowest to 

gheat in accordance with the factor x, we should expect to see an array of 
boxes from low to tall. Inspection of such an array would aid in guesstag 
the meaning of the factor a:. Ordinarily, one proceeds more simply by ex- 
ammmg all the me^ures which have high positive, small or negligible, and 
marked negative saturations, m order to guess from the nature of the meas¬ 
urements what IS implied by each factor. 

of ^hich has an appreciable part 

etitjrr' composition is 

would £ rr /k of boxes, so that the factor loadings 

Ten^d hnvf “ 1 ^ I collections, such as packing boxes, 

pencil boxes, jewelry boxes, would probably vary in relative dispersions of 

hat of boxes selected so 

wol rJb? in the height factor 

Zt m K T°'. ^nnld vanish, and, in fact, the 

HencrZ 2 instead of 3, which is expected for most box populations. 

“to ® invariant from one popvla- 

ZuiZ twT ^ny criterion of invariance in factor analysis 

kntToZ 'IT u ®nme population or to equiva- 

p p lations. In psychological analysis this principle means that fac- 

* First ed,, p. 66. 
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tonal composition cannot be expected to be invariant for different age 
groups, for example, or different groups of subjects, selected by criteria that 
are related to the factora involved. (We shall see later that the conffgura- 
tion may remain invariant for different populations, but we are here con¬ 
cerned with the numerical invariance of the factor loadings.) Limiting our¬ 
selves here to analyses that are made on the same population, we should ex¬ 
pect to find that if several samples are drawn from the same population and 
if independent factor analyses are made with the same battery of tests for 
the several samples, then the factor loadings should remain invariant for the 
different samples within sampling errors if the simple structure is complete 
and overdetermined. 

Let the measurement sj be made on each one of a group of boxes, as well 
as twenty other measurements of the same domain, relating to the rec¬ 
tangular box shapes. Now if the measurement s,- is heavily saturated with 
the height factor, we should certainly be disappointed with our factorial 
methods if the saturation of Sj on the height factor should turn out to be de¬ 
pendent on the other measurements that are taken on the same boxes. In 
the psychological field there is a comparable situation in studying the satu¬ 
ration of an opposites test, for example, on the verbal factor. If that test 
calls for a verbal factor, then the saturation of the factor in the test should 
not change if additional teats are given to the same subjects and then in¬ 
corporated into the test battery for analysis. When the multiple-factor 
methods were being developed, these considerations led to certain demands 
as to what should constitute an acceptable factorial method. It is a Junda- 
mental criienon of a valid method of isolating primary obiMies that the weights 
of the primary abilities for a test must remain invariant when it is moved from 
one test battery to another test battery* The same principle can be stated as a 
fundamental requirement of a successful factorial method, that the factorial 
description of a test must remain invariant when the test is moved from one bat¬ 
tery to another which involves the same common factors.] If a test with satura¬ 
tion on a factor were moved to another test battery in which that factor is 
absent, the factor would become a specific factor of the test in the second 
battery, and it would not be found by the factorial methods, which are lim¬ 
ited to the common factors. This limitation was made in order to make 
the factorial problem determinate. This requirement is a criterion for the 
acceptance or rejection of factorial methods. 

When a correlation matrix is factored, the result is a factor matrix with 
a set of orthogonal axes whose location in the test configuration is, in gen¬ 
eral, arbitrary and entirely dependent on the method of factoring. The 
first centroid axis is clearly dependent on the grouping of tests in the battery 
which is being analyzed. If there is a large number of verbal tests in the bat¬ 
tery and only a few number tests and space tests, then it is evident that the 

* Ihid., p. 66. t Ibid; p. 120. 
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first oentroid axis will lie ulose to tlic verbal tests. By cliaimiiiLr tho r,.. 
tion of tests of different kiiuls, the first eentmid axis'ran l.o move 
the configuration. It is clear that the projection of a test vector on the Am 
centroid axis will not be invariant when the t,e.st is moved from one batS 
to another battery. It will depend on the nature of tlie other tests S 
which It IS combined in eacli battei-y. Hence* the centroid axis should ^ 
be used for the interpretation of the factorial composition of any test Th 
same is true for all the eentroid axes, and the .same is also true for tiie prin! 
cipal axes whose location in the configuration i.s dependent on the eoi!!. 

cally self-evident, it will not be demonstrated by numerical examples. If a 



Fioukk 1 


toaXra^woS''be 'maximum variation in factor 

of different kinds of t marked variation in the proportions 

ture principle wa^lm “d ‘^yanance problem that the aimple-struc- 
teriesTtweiv^^^^^ represented two bat- 

9 t'^^ts each near A and P. 

only two each near R Tn “5° tests heavily saturated with A and 
In each of the tripu i u batteries have test j in common, 

tiorof the SpV '^ith an :r the approximate loca- 

tS;; wouM W I be seen that 

battery whUeit wouldT tbe major principal axis in the first 

ry, lie it would have a large projection on the major principal factor 
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in the second battery. Test j is far from the major principal axis in the 
first battery but close to the major principal axis in the second battery. 

If these two test batteries were factored by any appropriate method and 
if a complete and determinate simple structure were found, as shown in the 
spherical triangles, then we should find in the first battery that test j had 
a high saturation on the factor A, a small saturation on the factor B, and 
zero saturation on the factor C. The same result would be found in the sec¬ 
ond test battery, in spite of the fact that the two batteries differ markedly 
in the relative number of tests of each kind. The fadorial composition of a 
test ill a set of primary factors thai have been found in a complete and over¬ 
determined simple structure remains irwaiiani when the test is moved to another 
battery involving the same common factors and in which there are enough tests 
to make the simple strudure complete and overdetermined. This is one of the 
most important principles in multiple-factor analysis. It could happen that 
when a test is moved from one battery to another battery, one of the pri¬ 
mary factors would be represented by only two tests. Theoretically, this 
would be a common factor, but the location of this doublet factor might be 
indeterminate in the configuration of the new battery. For this reason we 
state the princ-iple with the specification that the simple structure should 
be complete and determinate in both of the test batteries before we can have 
assurance about invariance of factorial composition. If the simple structure 
is incomplete in one of the batteries, then the locations of the primary axes 
are, to that extent, uncertain, and then the factorial composition of the 
tests would also be uncertain. 

Types of factorial invariance 

The simplest form of factorial invariance concerns the metric invariance 
of the factor matrix solution. This is the problem of ascertaining the con¬ 
ditions under which the numerical values of the factor matrix solution are 
invariant. Since there is infinite variation in the possible locations of the ref¬ 
erence frame in the configuration, one should not expect any numerical in¬ 
variance in the projections of the test vectors on the reference axes (the 
factor matrix), unless one imposes some restriction on the location of the 
reference frame. It has been shown that the initial reference frame and, con¬ 
sequently,, the initial numerical values in the factor matrix are determined 
by the method of factoring which the author is free to choose to suit his con¬ 
venience. If any particular method of factoring is specified in sufficient de¬ 
tail, then two authors would generally get the same numerical values in the 
factor matrix, but that sort of computing agreement is not of theoretical or 
scientific significance. If we impose the restrictions of simple structure on 
the reference frame and if such a frame can be found in any given test bat¬ 
tery, then one can expect invariance of the numerical values in each row of 
the rotated factor matrix, even when a test is moved from one battery to an- 
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other which also has a dctorniinate simple structure in the same comm 
factors. Other restrictions on the reference frame which give invariance of 
factorial composition of a test when it is moved from fine Imttery to anothe 
can probably be found; but, so far, the simple-stnntture principle is the only 
restriction on the reference frame which 1ms given this type of metric i/ 
variance. ^ 

A different type of factorial invariance appear.s in rclati(jn to the selec 
tion of subjects to whom a test battery in given. This is conflgurational in. 
variance. The influence of selc(;tinn on faedorial results can be illustrated 
again with the boxes. The first diagram of Figure i? may represent the result 
of a factoriaJ analysis of a set of measurements on a collection of boxes. The 
spherical triangle XYZ represents the structure. The (fosine of the angle 



between the primary vectors Z and Y is the correlation between the pri- 
mapr factore m the particular collection of boxes measured. A similar inter¬ 
pretation applies to the other two sides of the spherical triangle. Now sup¬ 
pose that the same set of measurements was made on another collection of 
oxe^ Factorial analysis of the intercorrelations of measurements on the 
new box collection might give such a structure os is shown in the second 
^agr^of Figured Here the correlation between the two primary factors 
f u muc 1 iig ler, aa shown by the smaller angular separation between 

the two primary vectors in the second diagram. Both of the configurations 
are tri^gular because three primaiy factois are involved in both popula- 

>«<^Grpreted in the same way for the two 
populations, but their intercorrelations are different. This should not inter- 

identification of ea<,h primary factor, which can be 
e independently for each analysis when the structure is overdetermined, 
i-^^bered that the identity of a factor, the box height, for ex- 
affected by the fact that it correlates differently with other 
factors m different samples of boxes that may be chosen for measurement. 
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Confuaion about this rather simple idea has been responsible for misinterpre¬ 
tation of factorial results. 

In each of the two box collections the measurement 3 was in both test 
batteries. In the first diagram of Figure S one infers from the location of the 
measurement j that it is a function of both X and Y and that it does not in¬ 
volve the parameter Z, Furthermore, the fact that the test vector j is nearer 
Y than X makes it evident that the parameter F has greater influence on the 
variance of j than does the parameter X. The score function s,- might be 
some function like (2y+x), which would lie closer to Y than to X because a 
greater part of the total variance of this score function would be attributable 
to Y than to X. But notice also that the relative location of the measure j 
is the same in the second diagram of Figure $. This result is caused by the 
fact that, no matter what the correlation between the parameters X and Y 
happens to be in the particular population being analyzed, the score j is a 
function of X and Y but not of the parameter Z. Hence it must lie in the 
side XF of the spherical triangle. Furthermore, no matter what the correla¬ 
tion r*y happens to be, the score j is closer to F than to X because of the na¬ 
ture of the score function s,-. Here we have an example of configurational 
invariance. The factor loadings might change markedly from one popula¬ 
tion to another; but, if the same test battery is used on both populations, 
the configuration should be invariant. As a matter of fact, this is a far more 
important consideration in factor analysis than the invariance of the factor 
loadings. If the object is to identify a set of significant parameters for the 
description and understanding of a domain, it is more important to be able 
to make the identification as to the nature of the parameters than to ascer¬ 
tain that, in this particular collection of individuals that we happen to be 
studying, the correlations between the parameters have certain numerical 
values and that the saturations of some measure j are such and such for this 
particular group of individualB. Later, when the nature of each primary 
factor becomes well understood, it may be a matter of great importance to 
ascertain the numerical values for particular groups of subjects in the form 
of practical norms and the like, but not at the exploratory stage of investi¬ 
gation for which factorial methods have been devised. At this stage we 
are groping for some set of concepts or parameters in terms of which the do¬ 
main may be understood. The numerical values should then be regarded as 
being of three kinds, namely, those that are significantly positive, those that 
vanish or nearly vanish, and those that are significantly negative. Another 
way of stating the same idea is to point out that it is the factor pattern that 
is of importance rather than the fador matrix with its numerical entries. 
Configurational invariance can be represented algebraically by expressing 
the test vectors as linear combinations of the primaiy vectors. These rela¬ 
tions will be described in chapter xix, with numerical examples of the re¬ 
sults of univariate and multivariate selection in factor analysis. 
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Suppose, now, that a third collection of boxes is chosen for analysis, with 
the same set of measurements, and that all these boxes have the same height, 
X. The configuration would then collapse to the form shown in the third 
diagram of Figure S. The factor X disappears because it contributes nothing 
to the variances of the measurements, and the rank of the system is 2 in¬ 
stead of 3. The teat vector j is then identical with tlie parameter Y because 
it is a function of Y. The contribution of X is inendy a constant in the score 
function with no contribution to the variance. The factor X can hai'dly be 
expected to be identified when it is completely absent from tlie variances of 
the scores that are being analyzed. Of couree, it docs not follow that the 
factor X is absent from the individual members of the population. It is 
equally present in all of them and therefore does not contribute to their in¬ 
dividual differences. 

Another case of factorial invariance is that in which two different teat 
batteries are given to two populations. If the simple structures are complete 
in both batteries in the same common factors, factorial analyses should give 
the same configurations with different arrangements of the test vectors, un¬ 
less some of these are common to the two batteries. The identification of 
the primary factors would be made independently for the two analyses, and 
it should generally be possible to identify the same primary factors in the 
two batteries, even if they have no tests in comim)n. This type of result is 
the most convincing form of demonstration of the existence of primary men¬ 
tal abilities and their interpretation, especially if the fa(!torial compositions 
of new teats are predicted at the time of their construction and later verified 
with factorial results. It is best in such studies to iiududc several tests from 
previous studies as linkage, so as to make the demonstraticjn of the identity 
and nature of the primary factors more convincing. It could happen in 
such studies that the new battery would reveal common factors not previ¬ 
ously known. The result might be a reinterpretation of the older p rimar y 
factors or the breakdown of a primary factor into several new primary fac¬ 
tors. These results are dependent on the selection of test batteries, which 
are unlikely to be completely determinate for all the factors, especially in 
exploratory studies. * 

One form of factorial invariance that has been legitimately demanded is 
that in which a small test battery is selected from a larger one that has been 

* Some time ago the writer woa disappointed to find that u certain miw tost, called 
"DeBignB," did not show largo saturation on a certain perceptual factor which wo.*! the 
object of a factorial analysis. Later a possiblo explanation was found in the discovery of 
a new perceptual factor concerned with speed of oloeure. Tho old "Designs" test will be 
included in a study with other tests, suoh os tho GottschaLdt Figures, in order to deter¬ 
mine factorlolly whether this tentative explanation is sustained. If that is the case, then 
the interpretation of the perceptual closure factor can be made with a little more confi¬ 
dence. In this maimer and as a result of a large amount of experimental work, we shall 
eventually know something about the mental faculties. 
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shown to have a complete simple structure. The analysis of the smaller bat¬ 
tery could be made from a section of the larger correlation matrix. In such 
studies it should be expected that the smaller battery would show factorial 
invariance of the factor loadings if the smaller battery were selected so as to 
contain its own complete simple structure. If one of the hyperplanes is un¬ 
stable in either the larger battery or the smaller one, or both, then factorial 
invariance cannot be expected, because there would then be no criterion for 
locating the reference frame which determines the numerical entries in the 
factor matrix. 

Panic order and the normalized scale 

In most psychological tests the raw score is merely a numerical index of 
rank order. The reason for this interpretation of raw scores in psychological 
and educational teats is that there is no rational origin for the scale, and 
there is no defined unit of measurement which can in any fundamental sense 
be regarded as representing equal increments at the (Afferent parts of the 
scale, An exception is occasionally found in which all tests in a battery are 
scored in terms of time or of some natural spatial unit in which a rational 
origin can be used. The raw score interval from 20 to 30 points is not regard¬ 
ed as representing in any sense the same incre m ent of ability or achievement 
as the interval from 80 to 90. The origin of the scale is quite arbitrary, being 
determined by the number of easy itrans, by the scoring formula which is 
more or less arbitrary, and by such arbitrary matters as the time limit. The 
increments at the different parts of a distribution can be modified to repre¬ 
sent large or small increments in ability by the distribution of difiiculty of 
the items selected for the test. The shape of a distribution of raw scores can 
be made normal or positively or negatively skewed, at wiU, by merely al¬ 
tering the time limits and the distribution of difficulty of the individual test 
items. Under these circumstances there is little justification for dealing with 
the raw scores as anything more than rank orders for the subjects in an ex¬ 
perimental group. 

The problem is sometimes raised as to whether the distribution of intelli¬ 
gence in the general population is normal, but such a question has little 
meaning iinlfwi it is modified. One can ask, for example, whether a scale ex¬ 
ists such that the distributions of performances of successive age groups, are 
normal on the same scale. That is the problem of absolute scaling, and it can 
be rather easily solved. In dealing with the distribution of raw scores for a 
psychological teat, one has the privilege of defining the scale so that a par¬ 
ticular distribution of raw scores is normal, or one can define it so that the 
distribution takes any form one chooses. That is a question of definition. 
It is not a question of fact or a question to be determined experimentally. 

* L. L. Thuratone, "A Method of Scaling Psychological and Educational Tests," 
Journal qf Educational Psychology, Vol. XVI, No. 7 (October, 1925). 
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For example, an author has the privilege of defining his measure of stati 
as the logarithm of height in inches if he so chooses. The rank orders of V 
subjects remain the same. Similarly, one might decide to use the auarh!! 
range instead of the standard deviation as a measure of dispersion or the cn 
efficient of alienation instead of the correlation coefficient. These arp 
pies of monotonio functions. exam- 

If a transformation is made by which the distribution of raw scores be- 
comes normal, then one has, in effect, merely altered the numerical values 
of the individual scores so ns to retain the same rank order of the subjects 
Such a scale is a monotonic function of the original raw scores. For anv riven 
frequency distribution of raw scores one could determine, by eiuoiricri 
curve-fitting, the monotonic function which transforms the given raw 
scores to a new set of scores for which the distribution is normal. This would 
be an awkward way to solve the problem. A simpler way is merely to tabu¬ 
late the perceritile ranks of the given raw scores and to assign to each raw 
score the standard score which corresponds to the percentile rank. This is 

t'^ble, such as the Kelley-Wood 
tables The resulting scores are called normalized standard scores or simnlv 
nopnahzed scores. They should not be confused with standard scores deter^ 
mined by a linear transformation, which represents merely a translation of 
the origin to the mean and a unit of measurement equal to tlic standard de- 
distribution. This distribution of standard score.s retains the 
8 ape of the oiigmal distribution of raw scores, whereas normalized scores 

original dis¬ 
tribution may be. In both cases the rank order of the subjects is retained 

of cilr ^?if ® ^ orders instead 

of scores, ather the raw scores or the normalized scores. Such a procedure 

would probably be discouraged because, if the underlying distribution is 

r'^nr^ould of any shape, then the rank ordem in the middle 

tremts S+vf increments than the rank orders at the ex- 

Xtla fstib bl ® nonnalized scores 

IL ® ^ ^ appropriate than to use either rank orders or 

to n^r^Sr make it a desirable practice 

to normalize the raw scores before the factor analysis is made. 

fl flm normalizing the raw scores before factoring introduces 

retairthVr7“'”^''°t increasing functions of the raw scores 

Hence all monotonic increasing 
f^nchms of the raw scores are factoriaUy identical when the scores are normal 

rat “‘‘de betweenTev- 

eral methods of treatmg the original scores. These can be listed as follows: 

2 ) Fa^rin® obtained directly from the raw scores 

2 ) Factoring the correlations of normalized scores 
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3) Factoring the correlations of new scores obtained with a separate ar¬ 
bitrary monotonic transformation for each test and without normal¬ 
izing 

4) Factoring the covariances of the raw scores 

Comparisons of these different ways of treating the scores in factoring have 
shown that if the factor pattern is that of a complete simple structure, the 
different treatments of the scores in the factoring give essentially the Hama 
result. In general, the structure is retained in clearest form by the procedure 
of normalizing the raw scores before factoring, and that is the recommended 
procedure. The different treatments of the scores give different correlations 
or covariance entries in the correlation matrix, but the rotated factor ma¬ 
trix and the configuration determine whether the factorial results are the 
same. 

Invariance of factor loadings 

A numerical example of the invariance of factor loadings will be described 
here. A later chapter will be devoted to the effects of selection on factorial 
results and to configurational invariance. In order to make this numerical 
example as concrete and direct as possible, it was designed as a three-dimen¬ 
sional box problem. Measurements of a random collection of thirty boxes 
were actually made in the Psychometric Laboratory and recorded for this 
numerical example. The three dimensions, a:, y, and e, were recorded for 
each box. A list of 26 arbitrary score functions was then prepared. This is 
shown in the last colunm of Table 2, which shows, for example, that test 4 
consisted of the area xy of one side of the box. 

The data were analyzed in several ways, but only the analysis for the nor¬ 
malized scores will be presented here. After the score functions had been 
computed for each of the thirty box shapes, the distributions were normal¬ 
ized so that normalized standard scores were used for the computation of 
correlation coefficients. The resulting correlations are shown in TMe 1. It 
will be seen in the table of correlations that several pairs of columns are 
identical except for sign. This is the result of normalizing. For example, 
columns 15 and 16 in the correlation matrix are identical. Teat 16 was de¬ 
fined as x/z, while test 16 was defined as z/x. The rank orders for these two 
formulae are identical except for direction, and consequently the correla¬ 
tions are identical except for sign. In the same way the score functions x and 
3 ? would have been identical in the correlation if x* had been included in the 
battery. 

The correlation matrix was factored by the group centroid method, and 
the resulting factor matrix is shown in Table 2. The last column of the factor 
matrix shows the communalities. A frequency distribution of the third- 
factor residuals is shown in Table S, and it is seen that the average of the 
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absolute values of the residuals "was .0116, which hardly justifies extracting 
another factor. The fact that the three factors were sufficient to account for 
the intercorrelations agrees with the fact that three parameters, x, y, and 2 , 
were used in writing the 26 score functions of this battery. 

Table® 


Group Centroid Factor Matrix Factor Matrix qfter RotaUon 



1 

II 

III 

A * 

X 

r 

z 

Variable 

1 

.65 

-.67 

.38 

.98 

-96 

.01 

.01 

X 

2 

.74 

.63 

.37 

.97 

.02 

.02 

.01 

y 

3 

.76 

.06 

-.64 

.98 

.02 

.06 

.01 

z 

4 

.87 . 

-.04 
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.64 

-.03 
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.99 

.60 

.00 

.62 

xz 
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1.00 

-.04 
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yz 
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-.36 

.43 

1.00 
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.01 

xfy 
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-.56 

-.03 

.99 

.79 
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-.77 
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x/y 
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-.74 

.77 

-.06 

v/*' 

16 

-.05 

-.55 ' 
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.74 
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-.73 

xlz 

16 

.05 

.55 

-.80 

.00 

-.74 

-.02 

.73 

z/x 

17 
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.49 

.85 

.96 

-.07 

.80 

-.76 

y/* 

18 
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-.85 

.06 
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-.80 

.76 

ely 
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.48 

.07 

.61 

.70 

-.03 

2 x -|-^ 
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-.32 

1.00 
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-.04 

.66 

2x-i-22 
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1.00 

-.02 

.60 

.58 

2j/428 
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.05 

.47 
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.60 

.60 

-.03 

Va*+v» 
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-.01 

.68 
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.43 

.46 
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.02 

37 
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76 
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70 

-.02 

30 
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12 
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The method of extended vectors was applied tt) the factor matrix of Ta¬ 
ble 2, and the resulting diagram is shown in Figure 3. The three planes are 
hero immediately evident. All the points lie on or (dose to the sides of the 
triangle, except and 2G. Resferring to the list of score functions in Table g, 
wo sec that tluise two test nvjasurea were the volume and the main diagonal 
of the box, respectively. Both of those mea.surcs are functions of all three of 
the parameters, and conseciuently the two points 35 and 3G should lie inside 
the configuration. Hence they do not contribute to the location of the co¬ 
ordinate plano.s of the simple .structure. The li.st of .score functions was so 



dasigned that most of the scores were functions of one or two parameters 
and only two of the scores were functions of all three of the parameters. 
Hence a simple structure was inewrporated in the test battery. This is rep¬ 
resented by the fact that all but two of the scores dofined the triangular con¬ 
figuration of Figure S. By the method of extended vectors the transforma¬ 
tion A was determined, and the factor matrix after rotation is shown in 
Table 3. Diagrams for the two-dimensional sections are shown in Figure k- 
In Table 4 we have the correlations of the three primary factors, ®, y, 
and z, as determined from the battery of 26 measures. In the same table we 
have the correlations of the original dimensions of the thirty box shapes. 
The two sets of correlations agree closely. 
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men this analysis had been completed, a subbattery of 11 measures was 
selected from the longer list of 26 measures. The smaller list of 11 measures 
was made with the restriction that it should be balanced quite differently 
from the larger battery. The larger battery was equally balanced as to the 
three primary factors, x, y, and z. For the purpose of this demonstration the 
smaller battery was selected so as to contain a relatively large number of 



Figubb 4 


tests involving the primary factor y and only a few tests of the other two 
factors. The second battery was also selected with the restriction that the 
simple structure should be complete and determinate. This selection could 
be easily made from the diagram of Figure 3, The smaller battery was then 
independently analyzed. 

The smaller battery is shown in Table 6, The correlations were taken from 
the larger correlation matrix of Table 1. The group centroid method of fac¬ 
toring was used, but any appropriate factorial method could have been 
used. The mean absolute value of the third-factor residuals was .015, which 
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CorrelcUiona belwcen Pritnary Fadora 



X 

V 

z 

X 

1.00 

.22 

.21 

Y 

.22 

1.00 

.30 

Z 

.21 

.30 

1.00 



X 

y 

Z 

X 

1.00 

.26 

.23 

Y 

.20 

1.00 

.30 

Z 

.23 

.30 

1.00 


Table S 

Oroup Centroid Factor Matrix 


I 

II 

III 

A * 

.70 

-.20 

.58 

.90 

.78 

-.12 

-.56 

.02 

.01 

.00 

.03 

.81 

.05 

-.31 

.01 

1.00 

.82 

.43 

-.30 

.98 

.91 

-.29 

.32 

1.00 

.92 

-.18 

-.26 

.05 

.64 

-.32 

-.11 

.09 

.93 

-.31 

-.12 

.97 

.77 

.42 

.44 

.90 

.97 

.19 

CO 

o 

.98 


Factor Matrix after 
Rotation 


A ' 

r 

Z 

.00 

.05 

.00 

.04 

.88 

.01 

.03 

.05 

.79 

.62 

.03 

-.00 

-.06 

.54 

.57 

.82 

.37 

-.01 

.35 

.76 

.02 

.53 

.71 

-.09 

.52 

.71 

-.08 

.52 

-.07 

.65 

.42 

.43 

.43 


Table 6 

Correlation between Primary Factors 



X 

y 

z 

X 

1.00 

.18 

.20 

Y 

.18 

1.00 

.37 

Z 

.26 

.37 

1.00 
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did not Justify extraction of & fourth factor. The method of extended vec¬ 
tors was used in the centroid matrix of Tabls 6, and the resulting diagram is 
shown in Figure 5. The corresponding factor matrix after rotation is shown 
in the second part of Tuble 5. The figure and the rotated factor matrix show 
that a simple structure is present in the smaller battery, as was to be ex¬ 
pected. The correlations between the three primary factors determined by 



the smaller battery are shown in Table 6. The several tables can be seen to 
be very similar. 

The invariance of the factor loadings can be seen by direct comparison 
of the factor matrices after rotation in Tables 8 and 5. It will be seen that the 
factor loadings for the overlapping tests are very similar. This numerical 
example should serve to illustrate the principle that the factorial composi¬ 
tion of a test is invariant when it is moved from one test battery to another 
battery if the simple structure is determinate in both batteries. The in- 
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variance is independent of the proportions of tests which o™ k m 

urated with a^hprimaiy faato, sriong „ thraTrartura i“i^ ^ 
same common factors. defined m the 

A distinction must be observed in the discussion of factorial inv«w: 
between the characteristics 0 / factorial methods and the charaoteri^"'”'* 
the data to be analyzed. In setting up a criterion for what is to consrt f 
^ Kceptable factorial mathod, tha chief concern ia to inouro that th?mjf? 

od ja adaorato to diaoovar what ia datannlnata in tha dataXtorial 

od has not been designed to guarantee the discoveiy of factors whieh'n 
.Rinata in tha data. If the purpoaa of a fS,riJTnr2^S„“?.T 
atudy a p.^cuiar domain op a particular primatw factor then t 

tapy ahould ha daaigned to lit a oruoial aa^S Sa h™Xf , f 

Occ^mnally, such studies do produce interesting findin^Tut it isS?' 



CHAPTER XVII 

ALTERNATIVE METHODS OF ROTATION 

The problem of finding an analytical criterion for the reference frame 

The methods of locating a reference frame for a simple structure that 
have been described have all been graphical, and they have all depended on 
the selection of a subgroup of test vectors for defining each hyperplane. The 
graphical solutions in n-dimensional space are generally slow, and they re¬ 
quire a considerable amount of labor. Ever since the sunple-structure solu¬ 
tion was found for the problem of locating a reference frame, there have 
been many attempts to ai-rive at the solution without the graphical proce¬ 
dures. Scores of proposed solutions have been tried on a variety of factorial 
problems, but, with a few exceptions, they have not been published. None 
of them, so far, has entirely satisfied the desire to find a routine method 
which can be applied to a set of data without callmg for any judgment on 
the part of the computer. In this chapter we shall describe several pro¬ 
cedures for locating the simple structure when it exists in the test battery. 
They all require considerably less labor than the graphical methods. They 
are not entirely automatic, in that one cannot do the computations blind¬ 
folded, as it were; but they are in some degree successful, in that a consider¬ 
able portion of the work is done without plotting graphs. In fact, only a 
few graphs need he plotted, in comparison with either the method of two- 
dimensional sections or the method of extended vectors, which is really a 
method of taking three-dimensional sections. In the final acceptance or re¬ 
jection of a simple-structure solution it is still the appearance of a set of 
graphs that determines the answer. 

The problem of finding an analytical solution, for 'which many attempts 
have been made, can be briefly stated as follows: Let it be assumed that the 
correlation matrix has been factored so that a factor matrix of r columns is 
available. Let it be assumed, further, that a simple structure exists in the 
test battery. It would be desirable to be able to write explicitly the direc¬ 
tion cosines of the transformation A in terms of the factor loadings and to 
be able to solve for this transformation directly. 

The methods that have been tried consist generally of writing some func¬ 
tion 0 of the factor loadings and of the direction cosines of the transforma¬ 
tion matrix A, which is to be maximized or minimized at the desired solu¬ 
tion for each column of A. In effect, this general procedure consists in de¬ 
fining a subgroup of test vectors whose projections on one of the reference 
axes are to be minimized. These are the tests which have vanishing projec- 
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tions in a column of the oblique factor matrix V. Since the ideal solutinn ■ 
oblique, the solution for each reference vector is independent of the solution! 
for the other reference vectors. The choice of a subgroup for doliiiin^lT 

hyperplane is usually done graphically, but this work can be done at lelt 
in part, without graphical aid. ’ 

In practical work tliere frequently arise various forms of ambiguities that 
o^ol be resilyecl y slati.tic.1 it tl.„ structure ie h.oomp^“ 

It heppeue not mtrequenliy that the etructure of a test battei^ta ™ ’ 
Stable m one oi more dimensions or else indeterminate as to the exact rela 
tion of one or more factora to the test battery, it is best for the author tn" 
pr jent a set of pnmaiy a,xes as his interpretation of the data. Such inter 

factora that appeared unstable in the initial studios. In some factorial oml. 
fo!”d IS complete and so convincing that it leaves little Lm 

for doubt in the location of the reference frame. It is for such test batteri™ 

A successive approximation method of rotation 

P J^^lTre Vivlf numerical exam- 

vector that will hP dp method one starts with a trial reference 

yeSj ofthl Wal A P™j°ution of each test 

Th^ ^ ^ computed. It is the scalar product JA =«, 

marXT A of the oblique Ltir 

S te^tak « 1 distribution is made of the values of vj,. A subgroup 

distribution whoso projeetions on a new trial 

all ^ minimized. In selecting a subgroup, one may take 

all tests whose projections are in a range of sav + 30 or -i- 9 n if a « •+■ 

°° “ ‘‘h 

otato aJl CS™ “ sulMted which iu- 

+ 30 to -S 

‘l-c correlation ma- 

erW fill? 7^;°“° “noMonc with the other test, eotiefy two 

pariao“'S£al ifX ai”d T2U^T “ 

tests which hiiv ^ trial reference vectors is to choose those 

P^iecUen. on the centroid nxce, althongh thi. 

we have a rnr™i centroid axis. In Table 1 

»« eeventecn tete, selected from one et the 

t“n SS’dl, '• '’“P'P'iP” o! the columns of thnt corrda- 

t.on mMnx mdictes thst testa 1,2, and 3 should be suitable trial weetota 
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We choose one of these and normahze the test vector so that it is of unit 
lengtL This is the first tnal vector A„ which is shown in Figure 1. 

., denoting the succeffiive adjustments of a reference vector, we shaU oaU 
Its initial position Ao. After the first adjustment it will be denoted Ai, after 
the second adjustment A*, and so on. In the computations for any one ad¬ 
justment, the given position of a reference vector will be called Ag, and the 



FiauRE 1 


new position will be denoted Ap, which becomes Aj for the next adjustment, 
and so on until a satisfactory solution has been found. 

A correction vector Co is to be found, which is orthogonal to Aj, as shown 
in Figure 1. One such correction vector is found for each of the planes de¬ 
termined by the trial vector Aj and one of the fixed orthogonal axes M of the 
frame, defined by the given factor matrix. Hence there will be r correction 
vectors Co to be determined in a common-factor space of r dimnTtainna Let 
the unit vector M in the figure be one of the centroid axes or one of the axes 
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defined by factoring the correlation matrix. It is here drawn oblique to A 
because, in general, the trial vector A, is oblique to the centinid axes. The 
projection of A, on M is Xms, which is one of the r direction cosines of A,, 
Figure t has been drawn to represent only one correction vector Co in the 
plane of A, and one of the fixed orthogonal axes M. Then 

(1) AflM = . 

In this discussion, vectors will be denoted by capital letters and scalars 
by lower-case letters except for the test vectors which have been discussed 
in other chapters with the notation j. Let J be the projection of a test vector 


Tahlt 1 

Correlation Matrix 



1 

2 

3 

4 

s 

0 

7 

8 

0 

10 

11 

12 

22 

23 

24 

2fi 

26 

1 


.24 

.26 

.76 

.76 

.26 

.90 

.55 

.80 

.01 

.24 

.20 

.00 

.60 

.20 

.06 

.66 

2 

.24 


.35 

.77 

.37 

.79 

..59 

.92 

.33 

.35 

.89 

.07 

.82 

.34 

.80 

.73 

.75 

3 

.26 

.36 


.38 

.80 

.82 

.37 

.40 

.63 

.90 

.08 

.01 

.37 

.81 

.70 

.74 

.74 

4 

.75 

.77 

.38 


.07 

.67 

.95 

.03 

.73 

.50 

.72 

-.58 

.95 

.02 

.68 

.87 

.83 

5 

.76 

.37 

.80 

.07 


.09 

.77 

.58 

.95 

.97 

..50 

.75 

.61 

.05 

.08 

.87 

.80 

6 

,26 

.70 

.82 

.07 

.60 


.64 

.77 

.,54 

.74 

.06 

.97 

.08 

.08 

.07 

.88 

. 00 . 

7 

.90 

.59 

.37 

.95 

.77 

.54 


.83 

.86 

.63 

.67 

.49 

.87 

.71 

.55 

.84 

.76 

8 

.66 

.92 

.40 

.93 

.68 

.77 

.83 


.50 

.40 

.80 

.00 

.01 

.52 

.78 

.86 

.81 

9 

.80 

.33 

.63 

.73 

.95 

.64 

.86 

.69 


.87 

.47 

.58 

.05 

.80 

.54 

.82 

.73 

10 

.61 

.36 

.90 

.66 

.97 

.74 

.63 

.49 

.87 


.61 

.83 

.62 

.95 

,73 

.84 

.80 

11 

.24 

.89 

.68 

.72 

.60 

.96 

.57 

.88 

.47 

.61 


.00 

.73 

.58 

.04 

.85 

.86 

12 

.26 

.67 

.91 

.68 

.76 

.07 

.40 

.66 

.58 

.83 

.00 


.00 

.74 

.03 

.86 

.86 

22 

.06 

.82 

.37 

.95 

.01 

.08 

.87 

.01 

,05 

.62 

.73 

.00 


.50 

.70 

.85 

.86 

23 

.60 

.34 

.81 

.02 

.96 

.68 

.71 

.62 

.89 

.95 

.58 

.74 

.56 


.08 

.84 

.81 

24 

.20 

.80 

.79 

.68 

.68 

.97 

.55 

.78 

.54 

.73 

.94 

.03 

.70 

.68 


.87 

.01 

25 

.66 

.73 

.74 

.87 

.87 

.88 

.84 

.86 

.82 

.84 

.86 

.86 

.85 

.84 

.87 


.96 

26 

1 

.66 

.75 

.74 

.83 

.80 

.90 

.76 

.81 

.73 

.80 

.80 

.86 

.80 

.81 

.91 

.96 



j on the plane of A, and M, the plane of the figure. The projection of j on M 
is Oim, which is a cell entry in the given factor matrix F. Then, since M is a 
unit vector, 

(2) MJ = a,^ . 

The projection of j on A, is one of the projections to be minimized by an 
adjustment in the position of the reference vector. Tlicn, since A, is also a 
unit vector, 

( 3 ) JA.Q = Vj,. 

Applying the orthogonal correction vector Co to A, in the plane of A, 
and M, we have the long reference vector Aj,, namely, 

(4) 


Aj Co = Ai. 








381 


ALTERNATIVE METHODS OF ROTATION 

The direction of Ax, can also be defined conveniently by a correction vector 
Cm, which is collinear with M. * Let ’ 

(5) Cm=^M. 

Then 

(6) A.=A, + C„, 

t 

where A, is collinear with Ax,. We can write 

(7) Ar = tA^, 

where A, is a unit reference vector and f is a stretching factor. 

The projection of the test vector j on the unit reference vector Ar is vj,. 
It is the scalar product 

(8) JAr = Vjr . 

The length of the correction vector C„ is to be determined so that the pro¬ 
jections Vjr of the tests in the selected subgroup are minimized. Substituting 
(7) in (8), we obtain 

(9) tJK, = Vjr, 

and, by (6), 

(10) tJ{A, + Cm) =Vjr. 

By (5) 

(11) iJ'(Ag — sM) = vjr, 
which becomes 

(12) tJA, — tsJM = Vjr . 

By (2) and (3), 

(13) toy, - <30,m = Vjr • 

The problem now is to find the length s of the vector C*. so as to minimize 
the projections «,>. Squaring both sides of (13), we get 

(14) <®»Jg — 2fisVjqajm -1- <®s®oJm = Vj, . 

* The vector At is here defined with only one correction vector, Ct. It will later be 
defined with r such correction vecton, one for each centroid axis M, 
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Summing for all tests in the selected subgroup, we have 

(“) - 20.5 V,. + = v^,. „ 

■' i 

Writing the partial derivative of u with resnect tn a, .111 

zero, we obtain nspcct to s and setting it equal to 


(16) 


+ 2t*« Vn« = 


iym = 0 , 


from which 


(17) 


s = 


J _ 


»/, are known, s^nce^y U>e values of 

group on the first trial liorence vLm A ‘"jT 

tion paper with the^xes A andM cross-sec- 

test vectomy will be" the termini of the 

A. can be drawn so as to minimize^tho n^ • * "' *"®'^tion of 

through the points, by the meZi i!n «'>• best-fitting line 

through the origin. The zIoZ Xm i^t fiT"'T' 
length of the vector (?„, by which thn n ' ^ *^ the 

'“fez mini^Zd “ 

and thereby LTermte“avec1rJ^^^^^^ them to A, 

becomes the new unit reference vector a““ TIip“' TZ^I' Z®" normalized, 

equation ' ^ b® vector A* is defined by the 


(18) 


Ai = kA,, 


(5) and (6) we havZ^ h«-'' "nit projection on A,. By 

(19) 

A(A, - sM) = At. 

Since A. has unit projection on A, and since A, is a unit vector, we have 

AtAg = 1j 
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or, by (19) and (20), 

(21) fc(A, - 8Jlf)A, = 1, 

which becomes 


( 22 ) 


/cAJ — ksMAg = 1. 


By (1), and since A® = 1, we get 

(23) k - AsX™, = 1, 


so that 
(24) 


Ic 


1 

1 


One of the direction numbers of Al is represented in Figure 1 by the pro¬ 
jection of Ai on M. This is Xmi. The value of Xmi can be written 

(26) AhM = Xml. 

By (19) and (26) we have 

(26) ft(Aa - sM)M = X„i, 


or 


(27) AAjAf - AsM* = X„, ; 
and by (1) this becomes 

(28) AiCXmj - s) = X™j . 


Substituting (24) in (28), we get 


(29) 




XgTj e 
1 SXmfl 


which determines the direction numbers Xmi. Equation (29) is evaluated, 
separately for each of the r direction numbers X^i of Al. The direction co¬ 
sines Xmg of the trial reference vector A, are known, and the vector length s 
of Cm is determined by (17) for each of the r columns of the factor matrix F. 

When the direction numbers X^i of At, have been computed, this vector 
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can be normalized to unit length, and it can then be used as a new trial 
reference vector Aj. Its direction cosines are then given by 



It hM been'found that this method of locating the co-ordinate hvoer 
planes is more rapidly convergent if the vector A, is adjusted so as to ha 
orthogonal to the centroid vector A. of the subgroup a. The adjustment can 
be m^e on the vector A, in the plane of A, and A. so that its adjusted nosi- 
tion A« 18 orthogonal to A.. The adjustment vector may be denoted E,ao 


(31) A, -1- E = A„ ; 
and, since Au is orthogonal to Aj, we have 

(32) A„A« = 0 . 

By (31) we have 

(^3) (A,-^E)A. = 0. 

The adjustment vector E can be written as a fraction of A*, so that 

(34) E = &A,, 

where b is a scalar. Then 

(33) (Ai-fbA,)A, = 0, 

or 

(33) A,A, -I- 6A* = 0, 

so that 

(37) I. _ A,A. 

A* • 

Then, with b known, we can write, from (31), (34), and (35), 

(38) A„ = A| — A 

' A* 

'Which defines the vector Au. 
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Equation (38) can be written in terms of the r components of A„. We 
then have 


(39) 


— Xml 


Xm/Xmo 
m _ 


where Xmu ^re the direction numbers of An, and Xme are the direction num¬ 
bers of the centroid vector Ao. The components of As can be determined 
from simple summation in the factor matrix F over the subgroup s. We 
then have 


(40) Xm, = ^ o.„, 

which may be denoted briefly a on the computing forms. 

t 

The scalar product AjAa can be written in summational notation as 


(41) 


AiAtf “ XmlXmc 


and the denominator AJ can be similarly written as 

(42) 

m m \ f 

If we let 

(43) ^ = 
we can write the computing formula as 

(44) Xfnii = X|i>i “ 5Xino ■ 

When the vector Aa fias been determined, it is normalized and then becomes 
the new reference vector Ap. If this unit reference vector is to be adjusted 
again, it becomes the starting-point. A,, for the next trial. 

This method is simple as to the numerical work, which can be easily done 
by a clerk without instruction in factorial theory. The computational work 
will now be illustrated by numerical examples. 
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NunencdL example No. 1. 

For the numerical example of this method of locating the co-ordin«f 
hyperplanes of a simple structure we shall use a seventeen-vari^wlT 
problem selected from the numerical example of the previous chapter Tb* 
batteiy represents a three-factor positive structure. The correlation 

Table S. The computations are shown here without the summational nh i 
which are essential in practical work. mmational cheeks 

Iti Table 3 we have the same factor matrix recorded with onlv the 
d.g.t. It „ used m SOM, of the orosa produots in order to stap^fte 

Table S 


Tabus 
Factor Matrix F 



I 

II 

III 

1 

.06 

-.67 

.33 

2 

.74 

.63 

.37 

3 

.76 

.06 

-.64 

4 

.87 

-.04 

.48 

5 

.88 

-.40 

-.24 

0 

.89 

.41 

-.20 

7 

.84 

-.36 

.43 

8 

.86 

.22 

.43 

0 

.83 

-.65 

-.03 

10 

1 .86 

-.26 

-.44 

11 

.86 

.49 

-.01 

12 

.87 

.29 

-.38 

22 

.86 

.05 

.47 

23 

.80 

-.34 

-.32 

24 

.89 

.39 

-.16 

25 

.09 

-.01 

.01 

26 

.96 

.10 

-.02 


Factor Matrix Fi 
(One Decimal) 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

22 

23 

24 
26 
20 


II 


III 


.6 

.7 

.7 

.8 

,8 

.8 

.8 

.8 

.8 

.8 

.8 

.8 

.8 

.8 

.8 

.0 

.9 


-.6 

.6 

.0 

.0 

-.4 

.4 

-.3 

.2 

-.6 

-.2 

.4 

.2 

.0 

-.3 

.3 

.0 

.1 


.3 

.3 

-.6 

.4 

-.2 

-.2 

.4 

.4 

.0 

-.4 

.0 

-.3 

.4 

-.3 

-.1 

.0 

.0 


to to 

and S, a data 

dependent test ^ ^ as many in- 

usS Wtial t • 1 e ® be normalized and 

oo^t 4“^“^o' toriPB » wido nmise of oorrelation 

•P^SaSo^W^ ““ “■"■'“top Pmlto and also 

tors will he iiaoH relatively low coefficients. These three test vec- 

of Ttxble4 shows tS computations. The first section 

These thre^rtvei ”*'^^*^,- ?®®®^ copied from Tabled. 

eee three test vectors are normahzed, and the resulting direction cosines 
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are shown in the columns Ax, Ab,Ao of the transformation mat.ix Ao. These 
three unit vectors are the normals which define the three trial planes, A B 
andC. , 

In the matrix Vo of Table 4 we have the projections of the normal-length 
test vectors on these three reference axes. These are obtained by the com¬ 
putations F'A|)=F’o- In the same table we also have three frequency dis¬ 
tributions of these projections, one for each of the three trial vectors. The 


Tried Teat Veetora 



Test 1 

Test 2 Test 3 

I 

.65 

.74 

.75 

II 

-.67 

.53 

.06 

III 

.33 

.37 -.64 


Matrix Vo 



A 

B 

C 

1 

.99 

.25 

.24 

2 

.25 

.98 

.36 

3 

.24 

.35 

.99 

4 

.76 

.81 

.36 

5 

.77 

.35 

.80 

6 

.24 

.81 

.83 

7 

.93 

.60 

.34 

8 

.56 

.93 

.39 

9 

.91 

.31 

.62 

10 

.59 

.33 

.92 

11 

.23 

.91 

.69 

12 

.25 

.66 

.93 

22 

.68 

.84 

.34 

23 

.69 

.34 

.84 

24 

.27 

.82 

.80 

25 

.66 

.74 

.76 

26 

.56 

.77 

.75 


Table 4 


Example 1. Initial Veetora 
Matrix Ao 



Aa 

Kb 

Ac 

I 

.66 

.75 

.76 

II 

-.68 

.64 

.06 

III 

.33 

.38 

-.65 


Distribution Do 



ABC 

.9 

3 3 3 

.8 

4 4 

.7 

2 2 2 

.6 

3 2 2 

.5 

3 

.4 


.3 

- 5 5 

.2 

6 11 

.1 


+ .0 


-.0 



C-A'A 



Aa 

Ab 

Ac 

Ax 

1.01 

.25 

.25 

Aa 

.26 

1.00 

.36 

Ao 

.25 

.36 

1.00 


lowest six test vectors are designated by their projections in each distribu¬ 
tion as constituting a subgroup s. Each of the three subgroups is to be used 
for defining a plane. 

Finally, we record the matrix C, which shows the cosines of the angles be¬ 
tween the three trial reference axes. Inspection of this matrix shows that 
no two of them are sufficiently close together to define the same plane. 

. When the computations of Table 4 have been completed, a data sheet is 
prepared like Table 5. The top section of this table shows the computations 
for the adjustment of the A-plane, and it will be described in some detail. 
A strip is prepared for the six tests in the subgroup for plane A, In the dis- 



multiple-factoe analysis 

tribution of Table 4 we see that the subgroup for the A-nInno «««+ ■ 
projections below .30. In column A of the matrix Fq we find that tlm^ 
tests are 2, 3, 6, 11, 12, and 24. The factor loadings of the! sfx 
copied from column A of Fo, and they are recorded near the edge of 
strip in the proper position to match the factor matrix of Tabh^ ^ 
cross products, 2«;a, are then computed. In doing this, one places the strip 

Table S 


Example 1. First Trial 



adjacent to columns I, II, and III of Tnhh, n i ^ 

corded in column 1 oi Tbbhl 

each cdum?ofrSr®J ^‘^“tors loading of 

TMe f ^ computed and recorded in the second column of 

allv ty equation (17). This is, computation- 

cJknS ThetS?- by that of the second 

column, ine ratio a IS recorded in column 4. 
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In column 3 are recorded the direction cosines of the trial reference vector 
for the A-plane from the first column of Aq. 

Column 5 is self-explanatory. The entries of column 6 are determined by 
equation (29), and they are computed from columns 3, 4, and 6. 

Column 7 is computed by equation (40). These entries are merely the 
sums of the factor loadings in the three columns of Table 2, the summation 
being taken only for the subgroup. 

The entries of column 8 are determined by equation (39). The coefficient 
b is computed as shown in the fourth section of To&Ze 5. Its value for the 
A-plane is — .0159 as shown. 

The entries in column 8 are normalized to give the direction cosines of 
column 9. These values are also recorded in the new transformation matrix, 
which is denoted Ai in Table 5. Matrix C is also computed as shown, and 
it is seen that the three reference vectors are independent, since none of the 
side entries approach unity. In higher dimensions this fact is not a guaran¬ 
tee of linear independence, but it is usually a safe assumption. 

The same computational procedure is followed 'or the adjustment in the 
normals for the R-plane and the C-plane, as shown in the corresponding 
sections of Table B. The given factor matrix of Table 2 is now multiplied by 
the new transformation matrix, Ai of Table 6, and the result is the new 
oblique factor matrix Fi of Table 5. The frequency distribution of factor 
loadings in each of the three columns is shown in Table 5, and a subgroup is 
indicated in each distribution. It is a matter of judgment how large to take 
a subgroup. If it is taken too large, the corresponding factor loadings cannot 
be made vanishingly small. If it is taken too small, an indeterminate solu¬ 
tion may be obtained which is revealed in the final graphs. In the present 
case the lowest six tests in each distribution were taken to constitute the 
subgroup for the next adjustment. It is, of course, not at all necessary to 
have the same number of tests in each subgroup. The size of the subgroup 
usually varies from one plane to another, and it depends entirely on the 
factorial compositions of the several tests in the battery. 

In Tabu 6 we have the same type of computations for the next adjust¬ 
ment of the reference vectors, and it is seen in the frequency distributions 
of this table that the reference axes have been so adjusted that all the tests 
in each subgroup have projections that are close to zero for their respective 
reference axes. 

The next step is to plot the three graphs ABf AC, and BC. These are 
shown in Figure 2, and it is seen that the positive simple structure is here 
evident and is complete in all three of the common-factor dimensions. These 
graphs are plotted from pairs of columns of the matrix Fa of Table 6. One 
more adjustment of the reference vectors would bring the configuration 
even closer to perfection, but the appearance of the three graphs hardly 
justifies any additional refinement. 



multiple-factor analysis 

Numerical example No. 2 

numerical example started with three trial vectora th«t .■ 
tuted a ^md choice so that the simple structure was readily iSm ff"®**' 
out graphical assistance except for the final set of tlimn ^ with- 

by which ae structure w„ Lpted *1 S 
..cue, la the preset example we .hall .tart with a W SSetaaS^' 

Table 0 

Example 1. Second Trial 
A.-Plane 

Matrix V| 



® 'M-l'S-lil-:: 


's’" ;rai| IrfI ;■ 


•i ‘‘a z| 


>06 , 04 02 

•06 .01 m 

•0? .02 ira 

■0} .66 -.01 

• 0 * -00 .63 

~ Sa 51 •™ 

“6 >70 .02 

•70 -.00 .42 

•<0 - .03 ,78 

-• 0 ? .72 .41 

- .01 .33 .74 

.63 .60 - .01 

■6? - .01 .08 
.01 .88 .66 
*6 .48 .40 

.33 .80 .47 


Eistribulion Dj 


.0062 .0284 

20.6030 20.8038 

•0002 ,0010 



xl 

B 

0 

I 

ri 

in 

.44 

-.80 

.41 

.46 

.67 

.67 

1 1 

»bi^ 

gBi-*x4 


71 -iso .'87 -iol B ^'rn ~ 'in ~ ’7® 

C z ;}g _ ;“S -ijZg 

aids^ to^arri’vert^thrd ?^ with graphical 

It will be si Ihat In w?th „ K comlLn. 

solution can be found. 

anSjt e^SSttr'n* "f™ *'=•“<> ■» >" the p- eriou. ex- 

the Jailer Ma^ertt^rJ? »• 2. "ad 5. At the top of raW. 7 

matrix A, ™ h™ to, „r.h «>» 

we nave the same three vectom normalized to constitute the ini- 
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tial reference vectors A^, A^, A^. In the next matrix. C we havp + 1 , • 

of the angles between the three trial vectors. Here we notice 
the cosine of the angle between A and C is .77, which is unusuall 
the matrix F„ we have the projections of the teat vectors on the thr^t M 

and ta column C tho towct ..von teaU, ..ore ohrontTj” 
Tabu 7 

ExampU S. Initial Vedor» 

Trial VedoTs Matrix A. C-A'A 



.09 .26 .70 

.26 .98 .36 

■24 .36 .79 

•70 .81 .67 

.77 .85 .99 

.24 .81 .67 

■93 .60 .78 

.60 .93 .67 


10 

.69 

11 

.23 

12 

.25 

22 

.68 

23 

.69 

24 

.27 

26 

.66 

26 

. .66 


of^ui^ofF^'Z"^ this example were made without plotting pair, 

A and P have been circled tif aubgroupf 

the frequency distribution of mU aiibgroups chosen in 

the subgroup that has been cireled’^' It 

ohooen in tto f.e,uency dintribuH™ ti C in Wfe ^11°thl 1* ‘“'’T5 
Tb, oomputnbons for th, finrt trim um eb„™ “mltL tboy »» 
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.43 

5.00 

.61 
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1.43 

- .02 

2.17 

-.80 -. 

- .37 

1.12 

.63 

-1.03 

.61 , 




3.263 

4.33 

.88 

.76 

.34 

.38 

6.06 

.60 

.082 

.70 

-.40 

1.40 

1.66 

-1.16 

2.06 

-1.08 -. 

.648 

.62 

-.24 

1.06 

1.25 

-1.08 

1.3B 

- .08 -. 
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earned out according to the plan described for the first examnlp Th , 
w^anewsetoftrialreference vectors, as shown in the mS I 

gul^ separations are shown by the cosines in the matrix C The 
of the test vectom on the new trial reference vectors are shown in th! ? 
iqiie factor matrix Vi, and the frequency distributions of theao niv^- 
are also tabulated. At this point graphs L made"^:d we stw fn 
the graph for columns A and C of Fi. The siiberouD A is ^ ^ ® ^ 

frequency distribution of Table 8, but the subgroup C whkh r “w-® 
the graph, is not indicated by the distribution. A new subgroup C S “ 
from Figure 4 . It consists of the tests 8, 22, 4 , 7, and 1 With these ^ 



groups we proceed to the second trial ^ 

Table 9 computations as shown in 

C ifaTbeen drdS^Tt subgroup 

trial of a JV® ^'^^Svoup as determined in the previous 

«.l Witt the oiputt^m 0 r<SrKK.t t 
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thia trial. A plot of the pairs of columns of Vs in Table 10 shows the same 
structure as in Figure 2, which was accepted as final in the first numerical 
example. Note also that the matrix Ag of Table 10 is practically the same as 
the matrix Aa of Table 6, which terminated the first numeric^ example. 

This second example has been arranged primarily to show how the sub¬ 
group can be altered by graphs, which may be plotted for each trial. This 


Table 9 

Example 3. Second Trial 
A-Plane 



I 

2 

3 

4 

5 

e 

7 

8 

0 


Sno 

2 a * 


< (1 


g ) 



^mp 

r 

-.OUd 

3.64 

.43 

-.00 


.43 

■SI3 

.42 

.44 

II 

.038 

.70 

-. 7 fi 

.06 

Iml 

- .77 

2.17 

-.77 


III 

. U80 

.69 

.61 

.14 

HQJ 

.40 


.40 

.41 


B-Plane 


I 

-.004 

3.41 

.40 

- .00 

1.00 

.46 

4.82 

.46 

.46 

IT 

-.027 

.00 

.05 

- .03 

1.02 

.67 

- 2.16 

.67 

.87 

III 

.040 

.74 

.00 

.06 

.07 

.67 

- 1.34 

.57 

.67 

C-Plane 

I 

.291 

3.41 

.38 


.07 

.30 

4.81 

..37 

.46 

IT 

-.660 

.74 

-.68 


.48 

.17 

- .26 

.17 

.21 

in 

.101 

.82 

- .62 


1.12 

- .73 

2.51 

-.69 

-.86 


CoeJJicienl b 



A 

B 

C 

2 Xfli{Xfno 

.0711 

.0002 

- .4336 


30.7403 

20.6930 

20.6038 

h 

.0023 

.0002 

- .0147 


Aa 


AgAj “0 



A 

B 

C 

I 

.44 

.46 

mm 

II 


nil 

.21 

III 

.41 

.67 




A 

iJ 

c 

A 

1.00 

-.10 

-.32 

B 

- .10 

.90 

—.14 

0 

- .32 

-.14 

1.00 


Malrix Vj 



A 

B 

c 

1 

.00 

.04 

- .13 

2 

.05 

.01 

.13 

3 

.02 

.02 

.91 

.4 

.61 

.66 

- .02 

5 

.61 

.00 

.63 

6 

-.02 

.67 

.67 

7 

.83 

.40 

-.06 

8 

.38 

.70 

.07 

6 

.79 

-.00 

.29 

10 

.40 

- .08 

.71 

11 

-.02 

.72 

.61 

12 

-.01 

.38 

.70 

22 

.63 

.60 

-.00 

23 

.62 

-.01 

.60 

24 

.01 

.08 

.63 

26 

.46 

.46 

.44 

26 

.33 

.60 

.48 


DietribiUion I>» 



ABC 

.0 

111 

.8 

1 

.7 

1 2 2 

.6 

2 2 3 

.6 

2 3 2 

.4 

2 2 2 

.3 

2 1 

.2 

1 

.1 



+ .0 

3 3 1 

-.0 

3 3 3 

- .1 

1 


method of successive approximation can be used for factorial problems in 
which the assumption of a positive manifold is not imposed. The principal 
reason why the computational labor is reduced is that each trial vector is 
adjusted in all the dimensions of the common-factor space in each trial in¬ 
stead of being adjusted in only a few dimensions from the graphs in each 
trial. Hence the total number of trials is reduced. The successful selection 
of the subgroup of test vectors which is to determine each hyperplane is 
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beat made by graphical inspection. It must also bo remembered that 
final acceptance of a simple-structure solution for a test battery denends 
the appearance of the graphs. The various criteria by which ait of graX 

are interpreted have been discussed in a previous chapter on configuratiLg 
and factor patterns. •‘^‘figurations 


The method of minimizing weighted sums 
Theory of the method 

multiple- 
absolute 


One of the simplest methods of solving the rotational problem in 
factor analysis is that of locating each reference vector so that the 



sum of test projections is a minimum for those tests that lie in or near the 
hyperplane that is defined by the reference vector. If that group of tests 
were knovm beforehand, then the rotational problem would be easily solved, 

-ached ith sue: 

Suppose that a unit trial reference vector A, is located quite arbitrarily in 

projections t-y. are computed. It is 
sired to move this trial vector A, in successive steps to the position of a 

T- /■ differentiate between two sssump- 

“^®f'eator can make, namely, that the nearest primary rd- 

STXZ w r " “ ““mPuMonal outZe i. 
not affected by a wrong assumption as to whether the nearest primaiy refer- 
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enoe vector is bipolar or positive, but the solution is reached more quickly 
if the assumption is correct in this regard. If the original correlations are all 
positive or zero, it is a fairly safe assumption that the structure is a positive 
manifold. If the original correlations are both positive and negative, then 
some of the primary reference vectors may be positive while some are bi¬ 
polar, or they might all be bipolar. 


7ab2« 10 

Example S. Third Trial 
k-Phne 
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.006 

3.41 

.46 

.00 


.46 

4.82 
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G-Plme 
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.46 
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.40 

4.81 
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.175 
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.21 

.24 
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- .20 
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-.004 
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1.00 
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2.61 
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Coeffieierd b 
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B 

a 

2 X||||Xnio 
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30.7403 

29.6936 

29.5038 

» 


- .0001 
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Ai A|Ai~C 
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B 
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A 

B 

c 
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.44 

.46 

.46 

A 

1.00 - 

.13 
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11 

-.81 

.68 

-.03 

B 
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1 . 00 " 

III 

.39 

.56 

-.89 

C 

- . 12 \- 

.31 


Matrix Vj 
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B 
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.06 

.03 

• .03 

2 

.04 

.01 

-.00 

3 

.03 

.03 

.91 

4 

.60 

.64 

-.03 

5 

.62 

-.00 

.83 
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-.02 

.68 

.58 

7 

.82 

.39 

.01 

8 

.87 

.79 

.01 
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-.01 

.43 
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.41 

-.03 

.79 

11 
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.72 
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Let it be assumed that the projections vy, cover a wide range of both posi¬ 
tive and negative values. If it is assumed that the nearest primary reference 
vector is positive, then we should want to move the trial reference vector so 
that, in general, the negative projections will rise toward zero, so that the 
small positive projections will fall toward zero, and so that the high positive 
projections will remain high, or rise still higher, to identify the factor. This, 
adjustment would be accomplished by moving the trial vector A« so as to 
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increase the alpbraic sum of the prejcetions oxcfipt foi- tl,p „ ... 
projections which should be decreased. 

Let it be assumed, next, that tlie nearest primary referenr.n . ■ . 
;rhen w« d,„„ld „„t to movo A. o„ that tho otmn.rXo !' ’ 

tions use and the strong negative projections fall, thus identifvimr 

pooita »,d tho Stag „og.t,ve onos, whi,.!! 2“ 

If.it is desired to locate a residual plane, then tlie tcin] 
should 1» ^justed so thol oil its projoctiom «pp™ch Lr! Thm 

hese three cases can be suimnai-ized for convenience in Table 11 Th 
po..too and negat™ signs in tins table indioalo for oarh coso wheLS 

Table 11 


Valuea at 

For Locating 

I’rujedlidiig 

Ilcforoneo 


Vector 

iStroiiR noHitivc.... 

4. 

Small po.sifcive. 


Hinoll neeativu... 

4. 

htrong negiitivo. 

+ i 


i.iipDJur 

UoCoroneo 

Vector 


'CLuniuuai 

Hoforouco 

Vector 


• I _ 

adjustment of the trial vector should be made so a.s to on.irn +i ■ • 

»r. ™o or fall, i.o„ p, 

rocUonSnlr !'Tho^« "'‘k* 

rsference frame. "tIio test vertof / has\hn j? orthogonal 

P".Joctlon then be« "'mbeta o,.. so that Ihe 

(45) _ 

TTI 

The algebraic sum of the projections of all tho n tests on A, then i.s 

(46) y„, ^ ya y 

aC " 2^ai„ . 

3 m j 

»/. on jCm shorn*' ^ “8“™. »itll piPjection 
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which the direction numbera have been reversed. Then the desired ad¬ 
justment of A, IS such as to decrease both «« and Vk^. Let us denote the vec¬ 
tors whose projecfaons are to be increased or decreased by wherri 

Further, let 0 denote the algebraic sum of projections of all the test vec¬ 
tors WjJ on A,. This Bvm is the criterion which is to be maximized or mini¬ 
mized as the case may be. Then we have for this criterion 


(47) 






where the subscript p defines the hyperplane A„ which is to be located by 
adjusting the trial vector A,. ^ 



The adjustment of the trial vector can be made in the direction deter¬ 
mined by the maximum rate of change in the criterion 0 p. This is deter¬ 
mined by the partial derivatives of with respect to the direction cosines 
We then have 


(48) 


9<t>v _ , 

dKo 


where are the direction numbers of a vector L, as shown in the figure. 
The numerical values of Imq are merely the sums of columns of the original 
factor matrbc F with positive or negative signs as defined by %. The ad¬ 
justment of Aj should then be made in the plane of A* and L, either toward 
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L or away from it; but we have, bo far, no measure of how large the displace¬ 
ment of A, should be in this plane. 

In order to obtain a simple graphical method of determining the amount 
of displacement of Ag, we determine the vector E in the plane of A, and I, 
where E is orthogonal to A,. Then E is evidently a linear combination oi the 
given trial vector A, and the vector L. We then have 

(49) E = L — sA,, 

where the parameter s is to be determined. Since A, and E are to be orthog¬ 
onal, we set 

(60) AgF = 0 

or, by (49), 

(51) A,(L - sAg) = 0 , 

and hence 

(62) A,L = sA=. 

But since A, is a unit vector, we have simply 

(53) s - A,L , 

so that 8 is numerically determined as merely the scalar product of A, and 
L. By (49) and (53) the vector E is then located with direction numbers 
Bmg. Let C be defined as the vector E normaliised with direction cosines 
Cmg- We then have Ag and C as two orthogonal unit vectors. 

The projections c^g are next computed from 

(54) Cj-g = OijmCmq , 

m 

and a plot is made of a* against Cmg. From this plot the displac^ement of A, 
is determined. When A, has been adjusted to a new position, it can again 
be regarded as a trial vector to be adjusted. It has been found that each 
primary reference vector can be located approximately in five or six adjust¬ 
ments of this kind. The fine adjustments should be made by a whole set of 
plots of pairs of columns of Vjp, which are the elements in the oblique factor 
matrix F. The present method will locate some, or perhaps most, of the 
primary reference vectors, while some of them may need final adjustment 
by the complete set of diagrams from the columns of F. The present method 
seems to save a great deal of labor in solving the rotational problem. 
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Outlike 'of compyicUiona 

(1) When a correlation matrix has been factored into a factor matrix F, 
the rotational problem can be solved by the present method. A useful way 
to start is to select a test vector. Normalizing this test vector gives the unit 
trial vector A,. 

(2) Find the test projections on A, and tabulate them. 

(3) Place a strip adjacent to the column of projections vy, and mark on 
this strip negative signs for all teats which are to be reversed in sign ac¬ 
cording to the plan of Table 11, In the interpretation of this table one must 
make some decision as to what are to be regarded as large or small projec¬ 
tions. In the first few trials these bands should ordinarily be rather wide, 
but in the last few trials the bands may be narrower so that a projection is 
regarded as small if it is numerically smaller than .20. 

(4) Place this strip of signs adjacent to each column of F and determine 
the weighted sums (equation [48]), 

WyQjn = Ima . 

i 

(5) Find the scalar product (equation [53]), 

^ bqlj • 

m 

(6) Find the direction numbers Cmj of the vector E (equation [49]), 

E = L — sAq. 

(7) Normalize E to find direction cosines Cms of the unit vector C. 

(8) Check orthogonedity by the relation AjC'=0. 

(9) Find projections c,>, of the test vectors on C. 

(10) Plot Vjq against cym. 

(11) Locate a new trial vector as a linear combination of A, and C, as 
in the two-dimensional rotations. 

(12) Find the projections on the new trial vector, and repeat the process 
if necessary. 

In the interpretation of Table Hit may be useful occasionally to assign 
positive or negative signs to the extremes and\to ignore some of the test 
vectors that are already in the hyperplane. Thrae test vectors that are in 
or near the hyperplane are then given weights, wy=0. When this is done, 
there are three weights for w,-, namely, -|-1, — 1, or 0. 

When one or more residual planes are to be located, it is probably best to 
choose one of the last few centroid axes as trial vector. When a primary 
reference axis is to be located, it is convenient to choose a normalized test 
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vector iw tlie trial vector. The trial vc(-t«r fr.i- 

normalized te,st verdor cho.son from the tests that » 

(an avoid starting with a trial vector that mov/. • V ^^“^J'lanner 
one of the reference vect<ir.s already Iw-aicd. ’** Position of 

Nuvwrical example 

TVitfe IS 

/‘actor Matrix Po 



one of ctosen frbUrarT'^TJ ^ 

battery. Its direction numbers oie ro P™®' 

This vector is normalized by the multinV ■ 

tom of the first coJumn, and wo then b a* the b. 

trial vector, A, as shown in the next rT ?,;|“""tion cosinos of the fii 
vector.? on this trial vector are listed in S"""' i *® ^’^j'^ctions of the te 
It will be assumed that the structure k 

primary reference axes are assurSed I bt *1 

, ‘.I-. L. Thu^tone and Thcl ^ ^"‘her than bipolar. 

(Chioago: University of ChicagoTreSri^lI**'*™^™®’ Studies of Inlelligm 
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cording to T^U II, we should reverse the signs of the test vectors with small 

Til T by reversing the ei^ o 

al test vectors whose positive projections in this column are less 20 


Table IS 


Trial 1 


.40 . 47 - .63 -2.20 -.68 

-.£0 —.59 -3.07 -1.10 - 34 
.41 .48 2.46 .86 27 

-.25 -.29 - .36 .61 .19 

.17 .20 .03 — .64 —.20 

.18 .21 2.35 1.65 .51 

.11 .13 .10 — .33 —.10 

.08 .09 


1.178184 

3.3354 



.25 - .05 -.02 VIII 


I .36 . 34 - .89 -1.22 -.56 

~ -5® .04 .02 

‘SI ^-28 -77 .35 

~ ~ '53 --24 

V .16 .16 1.39 1.23 .57 

VI .30 .30 - .59 - .88 -.40 


. 310009 Norm! . 685664 


.00 .00 


.460062 
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63 - . 


41 —. 
68 . 
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68 

16 - . 

pH 

24 

09 


16 -1. 
12 


09 

09 - . 


16 -. 



Norm . 992925 
S 2.8484 


.281654 
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These negative signs are now copied at the edge of a strip which is placed 
adjacent to each colvimn of the factor matrix in Table 12, and the weighted 
sums are determined. These weighted sums arc recorded in column L of 
Table 18, trial 1. The scalar product s is next computed and recorded as 
shown. This enables us to compute the direction numbers c of the vector E, 
as shown in the next column. The normalizing constant for this vector is 
shown at the bottom of column e, and then we have the direction cosines 
of the unit vector C, as shown in the last column for this trial. It is useful to 
check the computations to make sure that the vectors C and A are orthog¬ 
onal by computing their scalar product, which should vanish. 


Table U 


TzsTa 

Tsiax 1 

Tbial 2 

TaiAi. 3 

Total 

Totai. 5 

C 

V 

± 

C 

V 

± 

C 

V 

± 

C 

V 

± 

C 

V 

± 


1 

-.30 

.17 


-.42 

.12 


-.30 




HTim 


.41 

.03 

■ 

2 

-.15 

.47 


-.43 

.43 


Bill 



.56 

Hlhl 


.47 

.34 


3 

-.37 

.26 


-.43 

.25 


-.26 

.18 


.01 

.13 


.40 

.17 


4 

-.46 

.05 


-.34 

-.04 


.17 

-.11 



-.06 


.41 

-.03 


6 

-.13 

.23 


-.26 

.21 

— 

mi 

.17 

— > 


.16 

... 

.31 

.18 



-.42 

.09 

— 

-.22 

■FTl 

— 

.25 



.20 

■CEl 


.33 

.06 


7 

-.67 

.04 


-.24 




Hlfil 



-.11 


.82 

-.06 


8 

-.67 

.05 

— 

-.18 

Hell 


BC3 

-.10 


.66 

-.08 


.86 

-.02 


9 

-.56 

.23 


-.15 

.12 

— 

.08 

■ifi] 

— 

HE] 

.11 


.83 

.16 



-.65 

.11 

— 

-.26 



-.04 

-.04 


.56 

-.06 


.64 

-.01 


11 

-.62 

.17 

— 

-.23 

HEii] 

— 

-.03 



.52 

■Lid 

... 

.56 

.06 

— 

12 

-.65 

.04 

— 

-.13 

-.07 


.11 



.48 

-.07 


.58 

-.03 


13 

-.10 

.76 


-.12 

.73 


Ha 



.36 



,21 

.70 


14 

.01 

.85 



.83 


-.05 

.83 


^1 



.00 

.82 


16 

-.01 

.83 



.81 


wm 



.33 

.77 


.16 

.80 


16 

-.47 

.17 


-.44 



-.24 



.64 



.45 

.01 


17 

-.52 

.08 





-.28 



.68 

-.14 


.47 

-.09 


18 

-.38 

.33 


-.47 

.26 

— 

-.32 


— 

Hxl 

.12 

— 

.49 

.17 


19 

-.35 

.23 


-.67 

.16 

— 

-.44 



.73 



.51 

.03 


20 

-.33 

mn 

— 

-.66 

.11 

— 

-.32 



.66 



.67 

.02 


21 

-.34 

.24 


-.61 

.18 


-.43 



.60 



.47 

.05 



The projections of the test vectors on the unit correction vector C are 
next computed and recorded in column C, trial 1, of Table I 4 .. 

The projections « arc then plotted against the projections c, as shown in 
Figure 7. The new plane is located os shown in this graph by its trace 
through the origin. The normal to the trace defines the new extended trial 
vector, A,. This new trial vector is a linear combination of the first trial vec¬ 
tor, A, and the correction vector, C. The vector equation for the new trial 
vector is shown in each graph. The parameter .18 in this graph is deter¬ 
mined readily when the plot is made on cross-section paper. The fine grada¬ 
tions of the cross-section paper are omitted in these diagrams. 

The direction numbers of the new trial vector are recorded in the first 
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by normalizing one of the teat vectors, which have small projections as 
shown in the last column of Table I4. 

The same procedure wjis used to locate the residual plane in this test 
battery. This was done by starting with the last centroid column of Table IS 
and by reversing the signs of all teat vectors which had positive projections 
on the eighth centroid axis. This leads to an improved po.sition for the resid¬ 
ual reference vector. One trial with this method was sufficient to locate the 
residual reference a.xis for these data. 

When the primary reference axes, as well os one or more residual refer¬ 
ence axes, have been determined by this simple method, the final step is to 
plot the whole set of diagrams, one diagram for each pair of reference vec¬ 
tors. Since there are eight dimensions in this problem, the final set of dia¬ 
grams will have twenty-eight graphs. Inspection of these graphs enables 
one to determine any further small adjustments that may be necessary to 
locate the best position for the simple structure. The present method should 
be regarded as adequate for obtaining an appro.ximato location of the refer¬ 
ence frame of a simple structure; but it should always be followed by a com¬ 
plete set of plots of pairs of columns of the oblique factor matrix, to make 
sure that the best location of the frame has been attained. The procedure 
here described is perhaps the simplest of the rotational methods so far de¬ 
vised, and it should serve to eliminate a very large part of the labor which 
has hitherto been necessary in locating a simple structure in multidimen¬ 
sional factor problems. 

In the application of this method or similar methods to tho rotational 
problem, it will be found that some configurations are dominated by the 
large variance of the first centroid as compared with subsequent factors and 
that this circumstance causes slow convergence in these solutions. In deal¬ 
ing with such configurations it may bo found useful to extend the test vec¬ 
tors os in the method of extended vectors. The configuration is then unal¬ 
tered except for the fact that all tho test vectors are extended so as to have 
unit projection on the first centroid axis. The present method can be ap¬ 
plied to such a configuration in the same manner as here described. In the 
location of the new trial vector, one has additional freedom, in that a streak 
of points on the diagram which are not radial can be brought into a hyper¬ 
plane directly by expressing the next trial vector as a linear combination of 
three vectors, namely, the given trial vector, the new correction vector, and 
the unit reference vector along the first axis. All the test vectors have unit 
projection on the first centroid axis, and the new trial vector can then be 
determined in the same manner as in the method of extended vectors. This 
procedure gives the solution in two trials with the present example. 

Another variant of the method hero described is to weight each of the 
co-ordinates of the correction vector inversely as the absolute sum of the 
entries in the corresponding columns of the given factor matrix F. The 
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Bfuii6 result can. be attained by writing a new factor matrix in wbich. the ab¬ 
solute sums of the columns are equal. This involves a distortion of the con¬ 
figuration^ but the simple structure is nevertheless invariant under this kind 
of distortion. The disadvantage of this procedure on experimental data is 
that the axes on which the variance is very much extended become so dis¬ 
torted that the residual variance is more difhcult to differentiate from the 
significant variance which is to be interpreted. 

A double-group method of rotation 

It happens not infrequently in a plot of two columns of the oblique factor 
matrix that the points reveal a concentration which could be fitted by a lina 
that does not pass through the origin. In previous chapters there have been 
a number of such cases. A few examples will be listed here to show the situa¬ 
tion in which the double-group method is applicable. Figure 3 of cJiapter x 
shows three such possibilities in the same diagram. In that figure there is a 
roughly linear arrangement of points that could be fitted by a straight line 
through points 1 and 3. A second line could be drawn through points 2 and 
3, while a third line could be drawn through points 1 and 2 . All but two of 
the points in the figure would be near one or more of these three lines. In¬ 
stead of locating the line through points 1 and 3, we might choose the cen¬ 
troids of the two groups, 1, IS, 18, and 3,15, 20, which would, in this case, 
give practically the same solution. 

In Figure 5 of chapter x we have another case. The two groups, 1, IS, 18, 
and 3,16, 20, might be chosen in this diagram to define the next adjustment 
in plane C. In Figure B of this chapter the plane C might be defined by a 
vector that is set orthogonal to the two groups, 2, 8, and 1, 7. 

The principle involved in this adjustment is to express the new vector Ai 
as a linear combination of the given unit vector Ao and the two centroid vec¬ 
tors G 1 and Cs of the two groups chosen graphically. We start, then, with the 
following notation: 

Aq = given unit reference vector, 

Ai = new unit vector to be determined, 

Cl = centroid vector for group 1, 

Ci = centroid vector for group 2 , 

Li = fciCi, where if = 1, 

La = fcaCa, where L| = 1. 

The vectors Li and Li are collinear with the corresponding centroid vec¬ 
tors. The new vector Ai is expressed as the linear combination 


(65) 


Ai- = Ao + PiLi -t- PiLi , 
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where pi and pa are scalars to be detemined. The vector Ai must satisfy the 
two requirements of orthogonality with Li and La. Then we have 

(66) AiLi = 0 
and 

(67) AtLa = 0 . 

Substituting the linear combination for Ai, we have 
(58) (Ao + piLi + paLa)Li = 0 , 

from which we get 

(69) AoLi -f- piLf piLiLi = 0 . 

Li is a unit vector, and hence 

(60) LJ = 1. 

Let AqLi == Si and let LiLa = 1. Then 

(61) Si + pi + pai = 0 . 

For the second condition of orthogonality, we have, similarly, 

(62) (Ao + piLj paLa)La = 0 , 
from which we get 

(63) Sa + pil -f- Pa = 0 , 
where sa = AoLa. Solving for pa, we get 


(64) 

and, by analogy, 

(65) 


Vi 


SiZ — Sa 


Pi = 


Sal — Si 

T^- 


When the parameters pi and pa are thus known numerically, the new vector 
Ai can be determined. It is normalized to become the new unit reference 
vector, Ap, When the double-group method is graphically indicated, it is 
quite effective. 



CHAPTER XVIIl 
SECOND-ORDER FACTORS 
First-order and second-order factors 

Most of the work that has been done so far in the development of factorial 
theory has been concerned with the factors obtained from the test correla¬ 
tions with or without rotation of axes for the selection of a suitable reference 
frame. Factors that are obtained from the test correlations wiU be caUedfitsU 
order factors, whether they are selected so as to be orthogonal or oblique. 
We shall now consider the factors that may be determined from the correla¬ 
tions of the first-order factors. Factors that are obUdnedfrom the correlations 
of the first-order factors will be called second-order factors. Factors of this 
type seem to be of fundamental significance in the interpretation of cor¬ 
related variables. 

Analysis of second-order factors and their relations to those of first order 
can be presented in several different ways. We shall describe these two 
factorial domains in terms of a literal notation, a physical example, a dia¬ 
grammatic representation, a geometrical example, and the matrix equations 
relating the two domains. 

Consider, first, a reduced correlation matrix for the tests whose rank is, 
say, 6. The factoring of this correlation matrix determines five arbitrary 
orthogonal unit reference vectors which may be denoted 1 , 11 , III, IV and 
Y. This orthogonal reference frame is arbitrary in the sense that it is de¬ 
fined by the method of factoring which happens to be used. This reference 
frame will be regarded as fixed, and all other vectors will be defined in terms 
of this fixed orthogonal frame, which is designated by the subscript m. Let 
it be assumed that a complete simple sti'ucture can be found in the test con¬ 
figuration and let the corresponding primary vectors be denoted A, B,C, 
D, and E. (These are ordinarily denoted T^, Tb, etc.). We shall assume 
that these primary traits are correlated in the experimental population. 
Then the primary vectors in the test configuration will be separated by 
oblique angles, whose cosines are the correlations between the primary 
traits in the particular group of subjects studied. Let these correlations be 
listed in a new correlation matrix of order 6X6i showing the correlations 
between primary factors. This correlation matrix defines the second-order 
domain just as the correlation matrix for the tests defines the first-order 
domain. 

The simplest case is that in which the five primary factors are uncorre¬ 
lated, in which case their correlation matrix is a unit matrix so that an 
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analysis of a second-order domain is not immediately indicated 

be the case m which the reduced correlation matrix for 

A,B,C, D, and E is of unit rank. There arc Z 

such a situation The correlations between the primaiy flltk^na 

lar expenmental population may be due to condition., r ^ 

subjects, and in this case the coLations woSd brorno ^ 

jmpor^oe ta the condition of sdectbn of tho e^Meeta Toe 

hind, the fiire pnmair functions, A, B, C, D, nnd S ituejlv Ho 1 ,*^° 
parameter in common, then one would exnept thoir’ ;> + ^ 

of u^dl mnt for different ubt^ZT^^^ *» 

m different wnye. In other words, the mere feet that . tt“l “ 

lations between variables, or between facton, Pon ^ ^orre- 

trivial circumstances does not guarantee that ni? ^ by scientifically 

.bl«amoftrivi,I.gnmcen:eTretrJd^^^^^^^^ 

factors in the present example should turn out to be of unit rank tL^+h^ 
circumstance merits a plos«r innU V . ^bis 


^ = f(p, a ), 

^ “/(P|C), 


^ = f(p, d ), 
^ = f(P, e ), 


tTt^o»X^uLw°" “ >“ »' 0 PTomeler such as o, 

it shares with the functions thatd °s*" °l another parameter, p, which 

bsppon to ScunsnSrc™ 1 »there shouid 

andsinthepsSrZroJ^r^m TT'*™ “■ '' 

order domain would bo dislurhed It th^’™ V?° '“"k the second- 

unit rank, then, in addition to the parLTeSTr c '''T 

order parameter or fap+nn « ^ o, o, c, d, and e, a second- 

nowhlr^^S “ ’™ 

the test comlationfl in s u r ii .l I since the rank of 

»et eorrelations is 6, it follows that these si, parameters are linearly do- 
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pendent. In fact the parameter p is now a linear combination of the other 
five parameter.. We can expreas theee relations by a set of parameters sth 

^ ^ combination of the five primary 
parameters. The five pnrnarres are parameters descriptive of the firstKrrdOT 
domain, and the pararneter or factor p is descriptive of the secondt^Jd” 
dom^, which IS of unit rank here. The second-order parameter is a litiA ftr 
combmatron of the five primaries that are defined by the original tes “S- 
relations. If some degree of consistency can be found for thefe parameto 
for differen groups of subjects, then all these parameters should repress^ 
some aspects of the underlying physical or mental functions. 

Consider, next, a set of correlated primaries. A, B, C, D, and E, in which 
the parameter p appears in the first order, as in the following example: 


^=f(p,a), D=f(p,d), 

5 = f(P, b) , E= f(p ). 

C=f(p,c), 


The rank of the reduced correlation matrix of the testa would now be 6. 
The five primaries listed above would he correlated and of unit rank. The 
second-order factor p would be determined from the correlations of the 
primaries. In this case the communality for the primary factor E would be 
near unity, thus showing that its total variance is common to the second- 
order factor p. Hence the primary factor E of the first order and the factor 
p of the second order would be identical. The presence, or absence, of the 
pnmaiy E could be determined by including, or excluding, a few tests in 
the battery. We see, therefore, that the appearance of a factor in the first 
order or in the second order may depend on the battery of measurements 
taken. Hence a factor should not be considered as intrinsically different 
because it appears in the second order. This circumstance can be deter¬ 
mined by the selection of the test battery. 

On the other hand, a parameter which always appears in the measure¬ 
ments in association with some other function would not appear as in the 
primary E, and it would be discovered experimentally, nearly always in the 
second order. Such a limitation could be introduced by the physical nature 
of the attribute which the factor represents, so that in such a case the second- 
order factor would represent something fundamentally different from that 
of the first order. A single-factor study is not likely to reveal whether a 
second-order parameter is fundamentally different from the parameters of 
first order or whether the differentiation is caused merely by the selection of 
the test battery. 
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In the following example wc have another combination of primaries; 


A = fij), a) , 1) = f(p, d) , 

B = f(p, h), E= m . 

C = f(T, c), 

In this example the I'educed rank of the test correlations would again be 

6. The correlations of the primaries would show unit rank for A, B, C, 

and D, The factor JS would be orthogonal to the rest of the system, so that 
its row and column would have side correlations of zero. The correlations of 
primaries would not be of unit rank if we consider the whole table of order 
5X5, but it would be of unit rank if we consider only the 4X4 table for 
A, B, C, and D. Relations of this kind can be found by inspection of the 
correlations of the primaries, and they may be indicative of the underlying 
order of the domain that is being investigated. 

The principles of a second-order domain have been discussed here in 
terms of the simple case in which that domain is of unit rank, so that there 
is only one general second-order factor. It should be evident that the or¬ 
ganization of the second-oi-dcr parameters can be of any rank and complex¬ 
ity. For example, the rank may be higher than 1, and the second-order fac¬ 
tors may extend to all the primaries or to only some of them. The possi¬ 
bility of third- and higher-order factors must be recognized; but their ex¬ 
perimental identification is of increasing difficulty the higher the order, be¬ 
cause of the instability of such a superstructure on practically feasible ex¬ 
perimental data. The number of second-order factors that can be deter¬ 
mined from a given number of linearly independent primary factors follows 
the same restrietive relations that govern the number of primary factors 
that can be determined from a given number of tests. Thus, for example, 
it is not to be expected that three second-order factors would be deter¬ 
minate from only five primary factors, for the same reason that three pri¬ 
mary factors cannot be determined from five tests. Furthermore, it is en¬ 
tirely possible in the same data for the first-order domain to give clear inter¬ 
pretation of a set of primary factors and for the second-order domain to be 
indeterminate or ambiguous in the same data. 

In order to avoid misunderstanding, perhaps it should be remarked that 
in factor analysis we are using the term paranwler in its universal meaning in 
science. A parameter is one of the measurements that are used for deseribing 
or defining an object or event. In statistical theory the term parameter is fre¬ 
quently used in a more restricted sense as descriptive of the universe, as con¬ 
trasted with a statistic, which is the corresponding measurement on a sam¬ 
ple. We are not using the term in this restricted sense. 
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The box example 

In order to illustrate the nature of first- and second-order factors we shall 
make use of populations of simple objects or geometrical figures and their 
measurable properties instead of dealing with these factors merely as logical 
abstractions. We have used a population of rectangular boxes and their 
measurable attributes to illustrate the principles of correlated primary 
factors, and we can use them also for the present diamiflainTi, 

A random collection .of rectangular boxes was represented by the three 
measurements, length (*), width (p), and height (z) (chapter vii). A list of 
measurements was prepared which could be made on each box, such as the 
diagonal of the front face, the area of the top surface, the length of a vertical 
edge, and so on. Each of these measurements represented a test score, and 
each box represented an individual member of the statistical population. 
The correlations between the measurements were computed and analyzed 
factorially as if we did not know anything about their exact nature. 
Each measurement was treated as a test score of unknown factorial com¬ 
position. As hM been shown previously, the analysis revealed three factors 
in the correlations for the particular set of measurements used. The con¬ 
figuration showed a complete simple structure, and a set of primary vectors 
was determined by the configuration. These three primaries represented the 
three basic parameters in terms of which all the test measurements had been 
expressed. 

The three primary vectors were separated by acute angles whose cosines 
represented the correlations between the three basic parameters that were 
used in setting up the box example. These three correlations could be as¬ 
sembled into a small correlation matrix of order 3X3. The physical inter¬ 
pretation of the positive correlations was that large boxes tend to have all 
their dimensions larger than those of small boxes. In other words, if one of 
the dimensions of a box shape is, say, 6 feet, the other dimensions of the box 
are not likely to be of the order of, say, 2 or 3 inches. The table of correla¬ 
tions of the three primary factors, X, Y, and Z, could be represented by a 
single common factor. This factor would be a second-order factor. It would, 
no doubt, be interpreted as a size factor in the box example. If this second- 
order size factor were denoted s, we should have four parameters for de¬ 
scribing the box shapes, namely, the three dimensions x, y, and z and the 
size factor s. These four parameters or factors would be linearly dependent 
because the rank of the correlation matrix of the tests was 3. 

In the case of the box example, a size factor or parameter could be deter¬ 
mined in the first order if desired. For this purpose we could use the first 
centroid axis, the major principal axis, or the volume vector, all of which can 
be easily defined in the first-order system of test vectors. The four param¬ 
eters so chosen would also be linearly dependent. If we wanted to use 
only three linearly independent parameters, including a size factor, that 
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could be done in the first order by choosing, say, the two ratios xly^n and 
?:/«=* r 2 as well as the volume vector v. These three factors would he linearly 
independent, but they would be correlated. The latitude with which we can 
choose simplifying parameters for the box example is determined in part by 
the fact that three factors can nearly always be represented by a common 
factor, whereas this is not the case when the rank is higher than 3. 

Diagrammatic representation 

The relations between the first-order and the second-order domains can 
be represented diagrammatically as shown in Figures 1 , 2, and S. In Figure 1 
we have a set of eight tests, whose correlations are accounted for by five 
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primary factors, A, iB, C, D, and E, which are uncorrelated. The factor A, 
for example, is present in the common-factor variances of testa 1, 2, and 4. 
The primary factor! E is present in the common-factor variances of all the 
tests, and hence E Iwould be called a general factor for the particular bat¬ 
tery. Since it is orthogonal to all the other primary factors, it would be 
called an orthogonal general factor of the first order. In order to determine the 
nature of the factor E it would be necessary to study it in different test bat¬ 
teries so that one could predict with certainty when the factor would be 
present and when it would be absent from a test. Since the primary factors 
are here represented as uncorrelated, the matrix of correlations of the pri¬ 
mary factors would be an identity matrix, and there would be no immediate 
provocation to investigate a second-order domain. 


SECOND-ORDER FACTORS 417 

In Figme Swe have represented a set of tests and five primary factore, 
A, B, C, D, and E. (We are not here concerned as to whether the particular 
number of teats represented in this diagram is adequate for the deteimina- 
tion of five primary factors. The purpose of these diagrams is merely to 
show the nature of the relations between the two; domains.) The rank of the 
correlation matrix of the tests would here be 5, which corresponds to the 
number of linearly independent primaty factors. In the present case we 
should find that the primary factors are themselves correlated, The matrix 
of correlations of these primaries would be of order 5X6, and it would be of 
unit rank. The correlations between the primary factors could therefore be 
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accounted for by a single general second-order factor that is denoted 0. If 
both the first-order and the second-order factors were to be used for the de¬ 
scription of the teats and the relations, we should have six parameters which 
would be linearly dependent because the rank of the correlations of the tests 
is only 5. In fact, the saturation of each test with the second-order factor G 
would be a linear combination of the saturations of the test with the five 
primaries of the first order. None of the primary factors are general factors 
in this figure. 

In Figure S we have a more complex relation, in that the correlation ma¬ 
trix for the primary factors would be of rank 2. One of the second-order fac¬ 
tors is here shown to be common to all but one of the primary factors; one 
of the second-order factors is a factorial doublet, in that it represents addi- 
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tional correlation between the primaries B and D; and the primary factor A 
is orthogonal to the rest of the primaries, so that it does not participate in 
the second-order domain. This diagram is drawn merely to illustrate the 
variations in complexity that may be found in factorial studies, 

The two types of general factors here shown in Figures 1 and Shave some 
interesting differences. The general factor E of Figure 1 is independent of 
the other primary factors, while the general factor G in Figure 2 is present 
in all the other factors. Hence we must conclude that a second-order gen- 

© 
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eral factor is a part of, and must participate in, the definition of the other 
factors, while tho orthogonal general factor li of Figure 1 is, by definition, 
independent of the other primary factors. It is evident, therefore, that a 
general second-order factor is likely to be of more fundamental significance 
for the domain in question than a general orthogonal first-order factor. An 
orthogonal general factor of the fimt order might operate in a test without 
any group factor, whereas a second-order general factor would operate, 
ordinarily, through the mechanism of some function that could be identified 
as a group factor, a primary factor, or a special ability. 

The factor patterns corresponding to the relations shown diagrammati- 
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caUy in these figures are given in Tables 1, S, and S. Table 1 shows the factor 
pattern for Figure 1. Here the orthogonal general factor E is identified by 
the fact that all entries of its column are filled. Table S shows the factor pat¬ 
tern for Figure 2, Here it is seen by the factor pattern that a group such as 
tests 1, 4, 5, and 7 have no primary factor in common and that hence their 
correlations would be determined only by the second-order general factor G, 
The determinant of the correlations for these four tests (the tetrad differ¬ 
ence) would therefore vanish. The second-order factor matrix is also shown 
in this table with only one factor 0 to correspond to this example. 


Table 1 


Orihogonal Factors 



A B COB 

1 

X X 

2 

XX X 

3 

X X 

4 

X 

X 

X 

6 

X X 

6 

XXX 

7 

X X 

8 

X X 


Tables 


Correlate Factors 



A B a D B 

1 

X 

2 

XXX 

3 

X 

4 

X 

5 

X X 

6 

XXX 

7 

X 

8 

X X 

0 

X 


Table S 


Second-Order Do¬ 
main of Figure 3 



F Q 

A 


B 

X X 

C 

X 

D 

X X 

E 

X 

F 

X 

G 

X 



a 

A 

X 

B 

X 

C 

X 

D 

X 

B 

X 


The question might be raised as to whether both types of general factors 
could be present in the same battery. That seems possible. In that case a 
simple structure could define the primary factors A, B, C, and D but not 
E in the particular battery of Figure 1. This factor could be assumed arbi¬ 
trarily to be orthogonal to the other factors, but then the line OE of Figure & 
would be erased to correspond to the fact that E is orthogonal to the other 
factors. One or more second-order general factors could be found in the cor¬ 
related primaries. If the correlations of A, B, C, and D were of unit rank, 
another alternative would be to set E in such a relation to the other primary 
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vectors as to maintain the unit rank with the second-order general factor. 

It might then be found that the vector E has non-vanishing projections on 
all the teat vectors, in which case both types of general factor would be as¬ 
sumed to be a possible set of explanatory parameters for the battery in 
question. It must be remembered that these various locations of the refer¬ 
ence frame for the explanatory parameters in both the first-order and the 
second-order domains have validity only in so far as they are suggestive of 
fruitful scientific interpretation. If this is not the purpose, then the factorial 
resolution might as well remain in the arbitrary orthogonal factors produced 
by factoring the given test correlations—or, better still, by not doing the 
factoring at all. 

It might be asked how the correlations of a test battery can be resolved 
into a second-order domain of unit rank which is lower than the rank of the 
test correlations. The transitions can be regarded geometrically. The unit 
test vectors usually define a space of as many dimensions as there are tests. 
When the reduced correlation matrix is considered, its rank is frequently 
lower than its order. Hence the reduction from the number of tests n to the 
number of primary factors r represents a reduction from the total variance 
of the teats to the common-factor variance. The complete correlation ma¬ 
trix for the primary factors represents a set of r unit vectors in os many di¬ 
mensions, the dimensionality of the common-factor space. The reduced 
form of this matrix for the example of Figure 2 would have unit rank be¬ 
cause the aide correlations are determined only by that which the primaries 
have in common, namely, the second-order general factor. 

Group factors and primary factors 

In Figure 4 we have a diagrammatic representation of a different kind of 
resolution of factors in the second-order domain and their relation to the 
primary factors. In this example the rank of the correlation matrix of tests is 
assumed to be five, as represented by as many primary factors, A, B, C, D, 
and E, Let it be assumed that the correlation matrix for these five primaries 
is of unit rank. The general second-order factor G then accounts for the ob¬ 
served correlations of the primary factors. If the five linearly independent 
primary unit vectors and the second-order unit vector Q are to be represent¬ 
ed in the same space, the dimensionality of this space must be six. It is 
possible to locate in this augmented space another set of unit vectors, a, b, 
c, d, and e, which are mutually orthogonal and which are also orthogonal to 
the unit vector G. Then we have the orthogonal reference frame G, a, b, 
c, d, and a, which defines the six dimensions of the first- and second-order 
factors but not the test apace. The five linearly independent primary factors 
define a five-dimensional space corresponding to the rank of the test corre¬ 
lations, and this space is a part of the total six-dimensional space of this 
representation. 
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The unit vector a is a linear combination of the unit vector G and the 
primary vector A. The relation is similar for the other primary vectors. The 
primary vectors A., B, C, O, andF are correlated andof unit rank, whereas the 
vectors a, b, c, d, and e axe arbitrarily set orthogonal to each other. In gen¬ 
eral, if the rank of the test correlations is r and if the correlations of the 
primaries are of unit rank, then the primaries define a unit vector G for a 
general second-order factor in an augmented apace of dimensionality (r+1) 
and.aJso a set of r mutually orthogonal unit vectors, each of which is in the 
plane of the second-order general f^tor and one of the primaries. These 
vectors are arbitrarily set orthogonal to the general second-order factor, and 
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they are called group factors. In Figure 4 . the primary factors are denoted 
A, B,C, D, and E, and the group factors are denoted a, h, c, d, and e. With 
this resolution we have (r+l) linearly dependent factors, which represent 
the test correlations of rank r. This type of resolution is preferred by some 
students, who use the reference frame G, a, &, 0 , d, and e because it is orthog¬ 
onal rather than the frame G, A, B, C, D, and E, which is oblique. 

A general second-order factor 

The algebraic and computational relations between the first-order and 
the second-order domains will be shown for the case of a single general 
second-order factor because of the interest of this case for the psychological 
controversies of the past forty years about Spearman's general intellective 
factor. The algebraic and computational relations to be shown can be gen- 
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eralized to second-order domains of higher than unit rank. It must be re¬ 
membered, however, that the restriction of our discusaiun to unit rank for 
tiie second-order domain dae.s not in any way imply that such low rank is 
always to be expected. The methods of analysts can be readily extended to 
a second order of higher rank when the data indicate a determinate second- 
order configuration. In any case the second-order rank should be consider¬ 
ably lower than the rank r of the first-order factors in order to justify inter¬ 
pretation. 

The primary vectors constitute a set of r linearly independent unit vec¬ 
tors that define a apace of dimensionality equal to the rank of the test corre¬ 
lations. In order to represent a general second-<jrder factor as a unit vector 
in the same configuration it is neceasary to augment the dimensionality to 
(r-hl) dimensions. A second-order domain of rank 2 would thus require an 
augmented space of dimensionality (r-1-2). The projections of the test vec¬ 
tors on these additional vectors in the augmented space can, however, be ex¬ 
pressed as linear combinations of tlie test projections on the primary vec¬ 
tors or on any set of r linearly independent vectors in the common-factor 
space. The procedures for determining these saturations will be shown with¬ 
out writing explicitly the (r-f-l) co-ordinates of the second-order unit vec¬ 
tors in the augmented space. 

The present discussion is confined to factorial data that satisfy two con¬ 
ditions, namely, (1) that a (toinpletc simple structure is revealed in the test 
configuration and (2) that the second-order correlation matrix is of unit 
rank. These methods can be adapted to the analysis of less than r primary 
factors, and the methods can be adapted to higher second-order rank. 

One of two objectives will be assumed, namely, (1) to determine the pro¬ 
jections (saturations) of the tests on the second-ordor factor in addition to 
the projections on the primary reference vectore or (2) to determine the pro¬ 
jections on the second-order factor and also on the orthogonal group factors. 
It will be convenient to discuss the algebraic relations under four cases be¬ 
cause of the different computational routes that may be chosen. These four 
cases are as follows; 

Case 1 . Transformation from F <o V, including the column vector G 

This transformation is shown in rectangular notation in Table 4 for the 
equation 

( 1 ) = Vjp , 

in which the matrix Vjp has an extra column for the second-order factor G 
with'elements Vja, which may also be denoted r,-, because these are the corre¬ 
lations between the tests j and the general factor G. The transformation 
matrix is identical with Amp except for the added column 0 with ele¬ 
ments which are to be determined. CJonsider the matrix T as an exten- 
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sion. of the factor matrix F. The rows of T give the direction cosines of the 
primary vectors T t with elements I in. The same transformation gives 

(2) = 

which is the diagonal matrix D except for the first column. Applying the 
transformation we have 

(3) Tirana =TIq, 


Table 4 

Case 1. TransformtAion from P io V, ImAiiding ike Column Vector G 



Case S. Transformation from F to U, Including the Group 
Factors and the Column Veclor G 
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where ri» is the first column of Vi and its elements are the correlations of the 
primary factors with the general factor G. These are known from the factor¬ 
ing of the unit-rank correlation matrix for the primaries. Then 

(4) 5 

and, since T = DA“‘, we have 

(5) ’Fm, = kD~^r,g, 

from which the first column of can be computed. Hence the column G 
of the augmented oblique factor matrix V becomes known. 

Case 2, Transformation from F to TJ, including group factors and general 
fadoT G 

Here the computation starts again with the orthogonal factor matrix F, 
and the objective is to determine the saturations of the tests j with the r 
group factors and the second-order general factor 0. This transformation is 
also shown in Table 4 in rectangular notation by the equation 

(fi) I' I 

where U is the factor matrix, showing the projections of tests; on group fac¬ 
tors and general factor G. These (r-f 1) mutually orthogonal factors will be 
designated by the subscript w. The first column of this matrix is again the 
column of correlations ry,. If the same transformation i.s applied to the ma¬ 
trix T for the primary vectors, we have 

(7) = U,„,, 

which is also a diagonal matrix except for the lirat column, which contains 
the correlations rtg between the primary factors and the second-order gen¬ 
eral factor G, These saturations can be determined from the unit-rank cor¬ 
relation matrix TT' = Ri for the primary factors.* Consider the first row 
of Ui. The two entries in this row show the direction cosines of T^ in terms 
of the orthogonal frame G, a, b, and c. The primary vector Ta is a linear 
combination of the two orthogonal unit vectors G and a. Hence, when ru is 
known, wo have 

(8) rf, + wf j = 1 

* Elfiewhere we have denoted this matrix Rp,, but we are hero using the subscript I for 
the primary vectors Ti and reserving the subscripts p and q for the primary reference 
vectors A, B, and C. Hence the correlations of the primary factors are here denoted 
R, instead of Rp,. 
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or 

(9) rliu + wSa = 1, 

80 tbsit the element uao is known. The other diagonal elements of I7i are 
determined in the same way, so that, for example, 

( 10 ) = 

When the matrix Ui is known, we have, by (7), 

( 11 ) = T-^Ut 
or 

( 12 ) = 

so that the transformation is known. The saturations of tests j on the 
second-order general factor 0 and the group factors w can then be computed. 

The transformation matrix represents a rigid rotation from one or¬ 
thogonal frame to another orthogonal frame, and hence this transformation 
matrix must be orthogonal by rows. A fourth row could be added to 
for a fourth orthogonal unit vector IV with cell entries which normalize 
each column. Then we should have an orthogonal matrix of order 4X4, 

Case S. Trjmsfdrmaiion from V to U, including the group factors and column 
vedor G 

Here it is assumed that the computations are to be made from the oblique 
factor matrix V. In Table 5 we have the transformation equation in rec¬ 
tangular notation, namely, 

(13) = !//», 

which gives the saturations of the tests j on the group factors and on the 
general factor. If the factor matrix V is extended to include the primary 
vectors Tt, we have the diagonal matrix D, Applying the same transforma¬ 
tion to jD, we have 

(14) = Ui, 
so that 


(16) 
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When the elements of Ui have been delenuitied as for Case 2, the transfor¬ 
mation can be written by merely adjusting the rows of [L by the multi¬ 
pliers of The transformation is then known. 


Table S 

Case 3. Transformalian from V In U, Including 
Ike Croup Faclora and the Column Vector G 




u 

G a b 


5 

X 

X 



S 



‘ 4 ^ 



X 



A 




Case 4. Transformation from V to Column Veclor Cj 



Case Transformation from V to column vector G 

This is the simplest case and perhaps the most useful as regards the 
second-order domain. The matrix V is known in determining the simple 
structure and the primaries. The saturations of the tests j on the second- 


\ 
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order general factor G are of interest, and these can be determined as linear 
combinations of the columns of V. Here we have the transformation shown 
in Table 5, namely, 

(16) = Ti, . 

Applying the same transformation to D*,, we have 

(17) = Tta . 

The elements of the column vector Vtg are known from the correlation ma¬ 
trix TT' = 'RI oi the primaries. Then 

(18) = DTpVte , 

and hence the column vector is known. In computing, it is necessary 
only to multiply the elements rig by the corresponding diagonal elements of 
to determine ^j,„. The desired column vector, r,-,, can then be deter¬ 
mined. 

4 trapezoid population 

In previous studies of factorial theory it has been found useful to illus¬ 
trate the principles by means of a population of simple physical objects or 
geometrical figures. The box population was used to illustrate three corre¬ 
lated factors and their physical interpretation. In the present case we want 
four factors in the first-order domain, which, by their correlations of unit 
rank, determine a general second-order factor. The correlations of three 
variables can nearly always be accounted for by a single factor, and hence it 
seems better to choose a four-dimensional system in which the existence of a 
second-order general factor is more clearly indicated by the unit rank of the 
correlations of four primaiy factors. For the present physical illustration 
we have chosen a population of trapezoids whose shapes are determined by 
four primary parameters or factors. 

The measurements on the trapezoids are indicated in Figure 5. The base 
line is bisected, and the length of each half is denoted by the parameter c. 
An ordinate is erected at this mid-point, and its length is h. This ordinate 
divides the top section into two parts, which are denoted o and b as shown. 
These four parameters, o, b, c, and h, completely determine the figure. The 
test battery was represented by sixteen measurements, which are drawn in 
the figure. The parameters a, b, c, and h are given code numbers 1,2, S, 
and respectively. Variables (13) and (IS) are the two areas as shown. The 
sum of (IS) and (IS) equals the total area of the trapezoid. In general, each 
of these measurements is a function of two or three of the parameters but 
not of aU four of them, and hence we should expect a simple structure in this 
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set of measurements. There is a rather gcmcral impression that a simni 
structure is necessarily confined to the positive manifold. In order to off!! 
this impres.sion we included here three additional mea.sure.s, which exS 

the simple structure beyond the positive manifold. The.se three addition i 
measures are os follow.s: monal 


14 = (l)/(2) = a/b, 1.-3 = (2)/(3) == h/c. IG = (l)/(3) 


ffl/c, 


necessarily introduce negative saturations on 

some of the basic factors. 

ThS ^ dimensions for a set of tliirty-two trapezoids 

These will constitute the trapezoid population. Each figure was drawn to 



Fioohe 5 

scale on cross-se^on paper, and then the sixteen measurements were made 
on each figure. Thrae constituted the test scores for the present example. 
In setting up the dimensions of Table 6 the numbers were not distributed 
t f ™ndom. To do so would tend to make the correlations between 
to an ^rthT^ “"d h, approach zero, and this would lead 

to invlw! 'T be no provocation 

JondSS The manner in which the generating 

TlaSr f ^ determine the factorial results will bo discussed in 

naralw^.^^ ^ T that, in addition to the four basic 

naJflmS! ■ ^bich functioned as a second-order 

generating the correlation between the four primary factors in 

correlations between the sixteen measurements for 
Che thirty-two objects were computed, and these are listed in Table 7. This 
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correlation matrix was factored by the group centroid method, and the re¬ 
sulting factor matrix F is shown in Table 8. The fourth-factor residuals are 
listed in Table 9, which indicates that the residuals are vanishingly small. 
Applying the rotational methods to the configuration, we found the trans¬ 
formation matrix A of TMe 10, which produced the oblique factor matrix V 
of Table 11. In this matrix we are now concerned with all but the last col- 

Table 6 


Trapezoid Parametera 



a 

b 

e 

h 

1 

1 

2 

1 

2 

2 

1 

2 

1 

4 

3 

1 

2 

3 

2 

4 

1 

2 

3 

4 

6 

1 

3 

1 

2 

6 

1 

3 

1 

4 

7 

1 

3 

3 

2 

8 

1 

3 

3 

4 

9 

2 

2 

1 

2 

10 

2 

2 

1 

4 

11 

2 

2 

3 

2 

12 

2 

2 

3 

4 

13 

2 

3 

1 

2 

14 

2 

3 

1 

4 

IS 

2 

3 

3 

2 

16 

2 

3 

3 

4 

17 

2 

3 

3 

3 

18 

2 

3 

3 

5 

19 

2 

3 

5 

3 

20 

2 

3 

5 

6 

21 

2 

4 

3 

3 

22 

2 

4 

3 

5 

23 

2 

4 

5 

3 

24 

2 

4 

5 

6 

25 

3 

3 

3 

3 

26 

3 

3 

3 

5 

27 

3 

3 

5 

3 

28 

3 

3 

6 

6 

29 

3 

4 

3 

3 

30 

3 

4 

3 

6 

31 

3 

4 

5 

3 

32 

3 

4 

6 

5 


umn. When pairs of columns of the factor matrix V are plotted, we have the 
configuration shown in the diagrams of Figure 6, in which a simple structure 
is clearly indicated. The cosine of the angle between the reference vectors is 
indicated on each diagram of Figure 6, These cosines were obtained from 
the relation C=A'A, as shown in Table IB. 

So far in the analysis we have found that four primaiy factors account for 
the correlations, and this corresponds to the fact that we used four param¬ 
eters in setting up the trapezoid figures. The four primary factors are cor¬ 
related, as indicated by the obliqueness of the reference axes in the dia- 
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grams of Figure G. The next step is to detonniiiu tiie eorrelations between 
the primary factors that correspond to the prinuii'y i-eferonco axes. For this 
purpose the iiworee of the matrix C is computed, as shown in Table 12. From 
the diagonal values of this matrix are found the numerical values of the 
diagonal matrix D, which is also shown in Ta}>le 12. The invorso of this diae 
onal matrix is also listed. These numerical values are uKircly the recinrociSfi 
of the entries in 1 ). 


Table S' 


Tabic 0 


Orlhagonal A’oetor Matrix F Ihslribuiionof 

Itesiduala 



Table 10 

Traniformalion Matrix A 


Table 11 

Oblique Factor Matrix V 
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In Table IS we have the correlation matrix Ri, showing the correlations 
between the primary factors. These are the cosines of the angles between 
the primary vectors. It can be seen by inspection that this matrix is close 
to unit rank, which indicates that a single general second-order factor can 
be postulated to account for the correlations between the primary factors. 
The saturation of each primary factor with this second-order general factor 
was determined by one of the special formulae for unit rank, and the satura- 


Table IS 



Matrix C =■ 

A'A 



Matrix Dtp 


A 

B 

C 

B 


A B C H 

A 

1.00 

- .24 

- .34 

- .17 


.SOS 

B 

- .24 

1.00 

- .36 

- .15 


.808 

C 

- .34 

- .36 

1.00 

- .11 


.786 

H 

- .17 

- .15 

- .11 

1.00 


.012 


Matrix C' 

-1 



Malrix 


A 

B 

C 

a 


Ta T» Ta Tm 

A 

1.53 

.73 

.83 

.40 

A 

1.237 

B 

.73 

1.53 

.84 

.44 

B 

1.237 

C 

.83 

.84 

1.62 

.45 

C 

1.273 

H 

.40 

.44 

.45 

1.19 

H 

1.091 


Table 13 


Correlation Matrix Rt = DtpC^Dpt Column Vector rtt 



Ta 

Tb 

Tc 

Tb 


rir 

T, 

1.00 

.48 

,53 

.34 

■FI' 

.71 

Tb 

.48 

1.00 

.53 

.33 


.70 

To 

.53 

.53 

1.00 

.32 


.73 

Tu 

.34 

.33 

.32 

1.00 


.45 


liesiduals 

= Rt 

- rtirin 

Column Victor 

^pg “ Dtprte 

1 

Ta 

Ta 

Ta 

Tn 


a 

Ta 

.50 - 

-.02 

HRfM 


A 

.878 

Tb 

-.02 

.51 



B 

.866 

Tc 

.01 

.02 

.47 


C 

.929 

r„ 

.02 

.01 

m 


H 

.491 
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tione are listed in the column vector rip. The inlerpretation is, for example, 
that the primary factor A has a correlation of .71 with the second-order 
general factor G. The closeness of the correlation matrix to unit rank is 
shown by the small side correlations in the rc.sidual matrix of Table IS. The 
diagonal values of the rc-sidual matrix show that part of tlie total variance 
of each primary factor which it does not .sham with the general second-order 
factor. If the diagonals of this matrix vanisluMl completely, then the pri¬ 
maries would have their total variance in common, and the original reduced 
(iorrelation matrix for the tests would have been of unit rank. 

The saturation of each test with the second-order general factor was de¬ 
termined as a linear combination of the columns of the oblique factor matrix 
V of Table 11. The transformation of equation (18) was used, and the nu¬ 
merical values of’Fpp were listed in Table 13. Column G of Table 11 was then 
computed by equation (16). 

The second-order general factor G can be interpreted in this example as a 
size factor, and it also indicates that, in generating the thirty-two figures, 
the four parameters a, b, c, and h were not allowed to take entirely independ¬ 
ent values. In other words, either the extreme forms of figures did not occur, 
or else they were used only occasionally. If the four parameters had been 
allowed to take entirely independent values, then there would have been an 
appreciable number of figures in which one of these parameters luid an un¬ 
usually small value, while some other parameter had some unusually large 
value. This interpretation of the second-order general factor leads to a con¬ 
sideration of what we shall call generating parameters. The present geo¬ 
metrical example illustrates the type of factorial organization that is repre¬ 
sented diagrammatically in Figure 2. The problem of interpreting the four 
primary factors can bo solved in this case without investigating the second- 
order domain. But if the correlations Ijetween the primary factors show un¬ 
expectedly low rank, then this fact can be utilized factorially in gaining fur¬ 
ther insight into the conditions under which the objects were generated. 
The four primary factors here identified by the simple structure were the 
four parameters that were used in setting up the problem. 

Generating parameters 

In addition to the primuplo of simple atruc.ture for the description of each 
individual object, we may consider an extension of this principle to the 
problem of describing tlie manner in which the measured objects were gen¬ 
erated. Other things being equal, we should prefer a set of descriptive param¬ 
eters that give some indication of the conditions that wore operative in 
producing the objects. To the extent that a factor analysis can throw some 
light on the conditions that were responsible for producing the objects and 
their measurable characteristics in addition to the description of each ind- 
vidual object, both by some simplifying set of pai'ametera representing cans- 
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ative factors, the factorial methods become even more useful as tools in sci¬ 
entific work. 

The numerical values of the trapezoid parameters in Table 6 defined 
thirty-two figures of various shapes. The method of constructing the table 
of four measures for each figure determined whether one or more second- 
order factors would be present and also whether each of the primaries would 
be equally or differently represented in the second-order factor, The fac¬ 
torial result could be altered indefinitely by the manner in which the objects 
were generated in constructing Table 6. Since it is the object of factor anal¬ 
ysis to reveal the underlying order in the domain, it is an essential part of 
the numerical example to show that there is a relation between the generat¬ 
ing principles and the factorial results. 

The first column of the table contains the three linear measurements 1, 
2, and 3. Suppose that these were inserted in the column entirely at random. 
Assume that each column was similarly constructed by distributing a set 
of measurements entirely at random. Then we should expect zero correla¬ 
tions between the four primaries, T^., Tb, To, and Th. The correlation ma¬ 
trix for the four primary factors would be an identity matrix, and it would 
not be factored because the primary factors would be statistically independ¬ 
ent. There would be no second-order factor present. 

If, for each one of these thirty-two figures with uncorrelated primaries, 
we should draw another one similar in proportions but with twice the area 
and another one with similar proportions but three times the area, then we 
should have a set of ninety-six figures, consisting of three sets that have 
similar shapes but different sizes. If this new set of ninety-six figures were 
analyzed factoriadly with the same battery of sixteen, measurements, we 
should find the same primary factors, but they would be correlated. Fur- 
thei'more, the correlations of the primary factors would all be the same, so 
that we should have a correlation matrix for the primary factors with uni¬ 
form aide correlations. The reduced correlation matrix would have unit 
rank, and all the four primaries would have the same saturation on the sec¬ 
ond-order general factor. This would be a situation with a second-order 
general factor which has a uniform effect on all the primaries. Here, again, 
the factorial result would be determined by the maimer in which the objects 
were generated. 

Suppose that a group of persons was asked to draw some trapezoids of 
arbitrary shapes and that these trapezoids were assembled as a population 
of figures to be measured and analyzed factoriaUy. Then we should almost 
certainly introduce a second-order size factor because our subjects would 
probably unwittingly draw the figures so that the several dimensions of each 
figure would be at least roughly of the same general order of magnitude. 
Some of the subjects might draw trapezoids of the general size, of say, 5 or 
6 inches, while other subjects might draw figures only 1 or 2 inches across. 
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Very few would produce trapezoids that are 1 or 2 inches wide and 10 inches 
tall. In other word-s, since some subjects would draw big figures and others 
small ones and since they would probably produce very few extreme figures, 
there would be strong correlation between the primary factors, and these, 
in turn, could be analyzed factorially into secondary factors. In this situa¬ 
tion the rank of the correlations of the primary factors would probably not 
be exactly 1, but the inference could certainly be drawn from the factorial 
result that secondary factors were operative to produce some big figures and 
some small ones in addition to the primary parameters that define the in¬ 
dividual figures. 

The interpretation of the second-order factor as a size factor in the trape¬ 
zoid example should be distinguished from the size factor that could be 
chosen as a parameter in the first-order domain. If one of the measurements 
had been the total area of the trapezoid, it would have been represented by 
a test vector in the middle of the configuration, since it wuirld be affected by 
all four of the generating parameters that were used and which appeared in 
the simple structure. The total-area test vector could be normalized to a 
unit vector, and it could be used as one of the parameters for describing the 
trapezoids. It would not be identical with the second-order size factor, but 
they would be closely related. Whether a size factor appears as a first-order 
or a second-order factor depends on the restrictive conditions under which 
the figures or objects are produced or selected and also on the selection of 
measurements for the test battery. It is interesting to note that here the 
results would indicate either that the thirty-two trapezoids had been sys¬ 
tematically selected by some restrictive conditions or else that the objects 
themselves had been generated under some restrictive conditions. 

When the factorial results are clear in both the first-order and the second- 
order domains, inferences can sometimes be drawn concerning the generat¬ 
ing conditions that produced the individual parts of the objects. Such in¬ 
ferences can be the basis for formulating hypotheses that can be investigated 
further either by factorial methods or by more directly controlled experi¬ 
ments. 

Incidental parameters 

So far we have considered the primary factors determined by a simple 
structure os representing parameters that can be given some scientific inter¬ 
pretation in terms of concepts that are fundamental for the domain in ques¬ 
tion, In using the simple-structure solution, which leads sometimes to the 
second-order domain, we have tried to avoid using arbitrary parameters 
whose only merit is that they serve in the condensation of numerical data. 
We have tried to find in the primary factor’s a set of parameters which not 
only describe the individual measurements but also reveal something about 
the underlying order in the domain. In looking for meaningful parameters 
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of this kind it would be an error to assume that all the factors have signifi¬ 
cance that transcends the particular experiment or the particular group of 
subjects. It would be strange indeed if factor analysis were immune from 
the distracting circumstances of the particular occasion. The experimenter 
must try to distinguish that which is invariant and which transcends the par¬ 
ticular experimental arrangement or the particular experimental group of 
subjects from that which is local and incidental to the particular occasion. 
In factor analysis we are not relieved of this difficult task any more than 
in other forms of scientific experimentation. In order to focus attention on 
this circumstance, it might he well to distinguish the primary factors which 
represent the invariants for which we are really looking from those primary 
factors which, though genuine as regards the explanation of the test vari¬ 
ances, are local and of significance only for the experimental group or the 
particular occasion. Primary fadors which characterize only a particvlar ex¬ 
perimental group or a particular situation may be called incidental factors to 
distinguish them from the invariants which are normally the object of acietUific 
experimentation. Incidental factors may appear in the first-order or in the 
second-order domain. 

A few examples will serve to illustrate the manner in which incidental 
factors may appear as primaries in factorial analysis. In addition to the 
primary factors that would be found in different groups of subjects, we 
might find primary factors that are imique for the particular occasion. Sup¬ 
pose that an exceptionally good examiner who is skilled in obtaining good 
rapport with the subjects should give a part of the test battery to a part of 
the experimental group. A primary factor might appear for this group of 
tests, and the investigator might be at a loss to explain it because he would 
be thinking about the nature of the tests and he would try to find something 
common in the psychological nature of these tests. It might not occur to 
him that this is the very group of tests that was administered by the experi¬ 
enced examiner. Such a factor would probably be left without interpreta¬ 
tion in the final results, or the interpretation might be one that would not 
be sustained in a subsequent experiment with different subjects and differ¬ 
ent examiners. Incidental factors are almost certainly present in every 
study. Hence the investigator should feel free to leave without intei'pretsr 
tion those primary factors which do not lend themselves to rather clear sci¬ 
entific interpretation. Even then the interpretation should, at first, be in 
the nature of a hypothesis to be sustained, if possible, by subsequent fac¬ 
torial studies. The fact that all the variances are not adequately accounted 
for in the interpretation has led some students to conclude that the whole 
result should be discarded, but that is not the case. It is quite possible to 
make an important discovery concerning the primary factors that are opera¬ 
tive in an experiment, even though the major part of the common-factor 
variances remains unexplained. It is assumed, of course, that such a finding 
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could be sustained by tlie construction of new tests with prediction as to 
how they should behave factorially in new groups of dllTerently selected 
subjects. 

In one factorial study it was found that a primary factor was common 
to a set of tests that were given by the projector method with individual 
timing for each response. Tlie interpretation of such a fact(jr was uncertain. 
Somo paycdiological fmudion might be involvtsd in the projector tests which 
was absent from the other tests; but the explanation might also be that some 
motivational condition was common to the projector tests that was absent 
from the other tests and whkh would be of only incidental significance as 
far as the major purposes were concerned. 

Suppo.se that one of the examiners iniaunderstands the time limits for a 
set of te.sts and that he give.s the .shorter time limits to a part of the group of 
subjects for some of the tests. A fachir might appear under certain circum¬ 
stances that would bo imudental and of no fundamental significance, but the 
primary factors that are significant might .still be revealed. An unexpected 
interruption in a school examinatwm, such ns fire drill, a street parade, or 
the anticipation of an important schwd event, may act to introduce inci¬ 
dental faiitors, 

(hie of the mo.st important sources of incidental factors is to bo found in 
thc5 selective conditions. If a group of suhjetds is sehseted because of quali¬ 
fication in a composite of two or more tests, the uni(iuo variances of such 
selective tests (foinbino to form one or more incidental common factors 
whicli would have remained a part of the unique variance if the selective 
conditions had not been imposed. The coiTelations between the factors are 
determined in large part by the selective conditions. If a group of subjects 
is selected because of certain test qualifications, it is to be expected that the 
primaiy factors will show correlations between factors that are different 
from the correlations between the same factom in an unselected population. 
It must not be assumed that the factors are different just because they cor¬ 
relate differently in different populations. This effect is well known with 
physical measurements—height and weight with intelligence, for example— 
whose intorcorrelations arc determined in large part by the selective condi¬ 
tions. These changes do not affect the identity of the factors. An incidental 
f actor which is introduced by conditions of solec tiori may bo trivial or it may 
be significant, depending on the nature of the unique variances which are 
intrtjducod into the coznmon factors by the selective contlitizms. 

It should be remarked that in a well-planned factoj’ial experiment the 
incidental factors are usually of secondary importance in comparison with 
the variance that is a-ssignable to the principal primary factors for which an 
experiment was planned. When one or more primary factors have relatively 
small variance and do not seem to lend themselves to clear interpretation, 
they should be reported without interpretation. Some reader of such a re- 
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port may find a fruitful hypothesis for it, or the factor may be of only in¬ 
cidental significance, 

These few examples will serve to call attention to the fact that not all the 
primary factors can be expected to have meaning in the fundamental sense 
of representing functional unities whose identity transcends the particular 
occasion. It does not follow that incidental factors are in any sense arti¬ 
facts. They may represent genuine factors that were operating to produce 
the observed individual differences, but their significance may not extend 
beyond the particular occasion. In that sense they are irrelevant to the 
purposes of the experimenter, even though they are valid as factors which 
can sometimes be identified. 

An interesting application of second-order factors is an attempt to recon¬ 
cile three theories of intelligence, namely, Spearman’s theory of a general 
intellective factor; Godfrey Thomson’s sampling theory, with what he 
calls "sub-pools”; and our own theory of correlated multiple factors, 
which are interpreted as distmguishable cognitive functions. The tetrad dif¬ 
ferences vanish when there are no primary factors common to the four teats 
of each tetrad, the correlations being determined only by the general second- 
order factor. 



CHAPTER XIX 

THE EFFECTS OF SELECTION 

Types of selection 

Factorial results are affected by selection of subjects and by selection of 
tests. It will be shown that the addition of one or more tests which J 
linear combinations of tests already in a battery causes the addition of one 

ZrTth “test battery reveals a simple struc¬ 
ture, the addition of tests which are linear combinations of the given tests 
leaves the structure unaffected, unless the number of incidental factor 
so large that the common factors become indeterminate. Such a situation 
violates the restrictive relation between the number of tests n and the num¬ 
ber of common factors r. 

When a factor analysis has been completed for a test battery on one group 
of subjects, the administration of the same battery to a differently selected 
group of subjects will give a different factorial result if the second group is se- 

found foi the first group of subjects, the same structure will be found for the 
second group, but the correlations between the primary factors will be dif¬ 
ferent Incidental factors are added to the common factors under certain 
oond.t.on= of =«on of the aubjcots. It »iU bo oho™ tbit" ta 
various conditions of selection of tests and subjects, a simple structure re¬ 
mains invariant. It will also be shown that the physical interpretation of 

bS Zw"'7 for wide variations in selection of 

both subjects and tests but that their intercorrelations are altered by selec- 

fund^mernif?"' considerations ore of 

fu^amental sigmficance for factor analysis os a scientific method. 

be illustrated by numerical examples with the box 
® and a, may have low correlations in one 

correlations may be quite different if the analysis 
IS lepeated on another group of boxes so selected that they are all, say, rela- 

lilv beXred™ance is reduced, and the correlations 
^ ^bese altered correlations of the primaiy factors 

tcSbtofl, H height, and Jdth, to 

thTsl^^^VnH both box populations. The factors ai-e 

tionsT^pn beir physical interpretations are the same in both popula- 
intercorrelations alter from one expeiumental popu- 
ampl ^ ^b*s “'apl® pnnciple will be illustrated in numerical ex- 
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Experimental dependence 

One of the most important sources of incidental factors which are extrane¬ 
ous to the purposes of a factorial study is what we have called experimental 
dependence. In earlier studies with the factorial methods this source of fac¬ 
tors was not recognized, but for a number of years this principle has been 
applied in the preparation of test batteries in the Psychometric Laboratory 
at the University of Chicago.* In Table 1 we have the factor pattern for a 
set of five tests (1, 2, 3, 4, and 5) with two common factors, A and B. The 
reduced correlation matrix of this battery would be of rank 2, corresponding 
to the number of common factors. For each of these five tests there is also 
indicated in the factor pattern a unique variance. Now suppose that the 
performance from which the score of teat 1 was derived is also used to derive 


Table 1 



A 

B 


Unique Factors 

1 

X 

X 

X 


2 

X 

X 


X 

3 

X 

X 


X 

4 

X 

X 


X 

S 

X 

X 


X 

la 

X 

X 

X 



another score, lo. Then we have two test scores derived from the same per¬ 
formance, and they are quite likely to share some of the uniqueness of that 
particular performance. This fact is indicated in the factor pattern by the 
two s’s in the third column. Tests 1 and lo share the same uniqueness. In 
addition, the two tests 1 and lo may also have unique factors that are not 
shared, but these are not indicated in the factor pattern of Table 1. 

A simple example of this manner of constructing a test battery would be 
to record speed and accuracy as two scores from the same teat performance 
in the attempt to cover all aspects of the domain that is being investigated. 
The new factor pattern, after adding test lo, has three common factors. 
The third common factor has saturations in only 1 and lo. It should be 
noted that the rank of the reduced correlation matrix has been raised from 
2 to 3 by this manner of assembling the test battery. In factoring the test 
battery it would be necessary to extract one additional factor from the cor¬ 
relation matrix before the residuals vanish. After rotation of axes, a third 
common factor would be found on which only two tests have significant 
saturations, namely, 1 and lo. Upon examination of their nature it would be 
found that these two tests derive from the same test performance. Such a 
factor on which two variant scores of the same performance have satura- 

* The importance of experimental dependence in factor analysis was first pointed out 
by Ledyard Tucker. 
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tions is called a doublet factor, and it is ignored in interpretation. It 
gives any leverage on the problem of interpreting what the factor 
represent, except that it is something concerned with that test nerform ^ 
fMt th^t was known bstore the Ltoring bog“ 
beet to avoid ineerting to a teet batten L or nfo" 
taken from the same test performance. 

t ^ duplicate form of each 

test to the battery, or by using each test and a parallel form of it then w! 

have a battery of ten tests instead of the five tests with which wo started 
h! “pique variance for each teat, then the factor pattern of Tabh'l 

IS altered by introducing five new common factom so that there are seven 
common factors in dl, the two factors common to the five original tests and 

Jubtful whether a useful resolution of the correlation matrix into common 
factors IS then possible. The unique variances have been made into common 
varianc^ by the inclusion of a parallel form of each test, and the common 
factors that might be significant would be obscured by the addition of fits 
oomnion factors that may make the factor problem insoluble 

experimental dependence 

before factoring 18 begun. One of the moat common forms of experimental 

oiy to be factored. A mental age, for example, is essentially a summation 
score. It 18 known before the analysis is begun that the total score will be 

that hence it contributes nothing to the identification of the primary vec¬ 
tors whio^h are at the comers or intersections of the configuration. Nor does 
definpdh'‘ih ^ the identification of a second-order general factor which is 
found to^L ® the primaries. However, a total score may be 

Inv one of the n ■ second^^rder general factor thalon 

of thn PrmariM. Ihe best procedure is to investigate the structure 

- t ■ ^hout the summation score and to investigate the char¬ 

acteristics of the summation separately. 

Linearly dependent tests 

linl^ToTdtn!! "7®rf experimental dependence and 

S fCelv “ ° 1 r “7 t« ^ test battery a now test score 

Cvflinem dICr ^‘"‘’^‘'.^"tnnation of test 8core.s from the battery, we 
^ L enL 77?-® rintroduces a now common factor. 
^iiaM^rs are combined have no unique 

te^wW^^ni- 7 The introduction of anew 

^ ^ combination of tests already in the battery is represent- 

S) wRh Wo' 1 «t five tJto r2 3,4. 

and 5) with two common factors and five unique factors. If a new test were 
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added by merely taJdng the sum of the test scores 1 and 2, we should have 
the test denoted (1+2). This test is indicated as participating in the two 
common factors A and B and in the uniqueness which adds two more com¬ 
mon factors. 

Univariate and multivariate selection of subjects 

When a factor study has been done on a particular group of subjects 
with a given test battery, it is of fundamental interest to know how the 
factorial results would be altered if the analysis were repeated on another 
group of subjects differently selected. Here we are not interested in whether 
one of the groups is in any way representative of a universe while the other 
group is not so representative. For our purposes the two groups are co¬ 
ordinate, but they are differently selected so that they differ in homogeneity 
in one or more factors. The results for either group are assumed to be 
known, and we want to be able to predict the factorial results when we know 
how the second group was selected in comparison with the first group. 





A 

B 

1 

2 3 4 6 

1 

X 

X 

X 


2 

X 

X 


X 

3 

X 

X 


X 

4 

X 

X 


X 

5 

X 

X 


X 

(1+2) 

X 

X 

X 

X 


Consider the selection of a second group of subjects so that they are more 
homogeneous, or less, in one of the tests in the battery. This test will be 
called the selection test, and it will be denoted I. The variances of aU the tests 
have been arbitrarily reduced to unity by standardizing the scores for the 
first group so that in that group (r,-= 1 and, in particular, so that iri = 1, Let 
the new group be selected so as to have a different standard deviation in the 
selection test I, and let it be denoted sis^l. The new group of subjects will 
have different standard deviations in all the tests that have correlation with 
the selection test 1. These new standard deviations will be denoted sj. The 
problem then is to estimate the new test correlations and the new factorial 
results for the second group. The selection of a new group on the basis of 
their homogeneity in one of the testa has been called univariate selection by 
Godfrey Thomson, who has investigated this problem and whose results 
will be summarized here. Univariate selection can be either complete or 
partial. If the new group of subjects is so selected that all the subjects have 
the same score in the selection test J (<ri=0) , then we have complete univariate 
selection. If the new group is selected so that vit^O, then the selection will 
be called partial univariate selection as to the selection variable 1. It will be 
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shown that interesting differences in the factorial results are detennined bv 
univariate selection when <r,> 0 and when o-.=0, which represents complete 
homogeneity in the selection test. Further, it will be shown that the fac¬ 
torial results are also affected by the commimality of the selection test I so 
that the results differ according to whether A? = 1 or /if < 1. ’ 

When the selection of a second group of experimental subjects is deter- 
mined by more than one selection te.st, we have mullimriaU seleciion. The 
principles of multivariate selection can be illustrated in terms of two selec¬ 
tion tests, denoted I and m. Such a situation can be analyzed as two ma- 
cessive univariate selections. In multivariate selection one is likely to be deal¬ 
ing with a composite selection test, c=f(l,m). This is the case of multivari¬ 
ate selection that has been studied by Godfrey Thomson and by Walter 
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Ledermann. Here, also, the factorial results are affected by complete and 
partial selection in the composite criterion of selection and by the communal- 
ities of the selection variables. The theory of univariate and multivariate 
selection will be described and numerically iUustrated, and a comparison 
will be made of the psychological interpretations of the resulting factors. 
Geometrical representation 

Before writing the vector equations which repro.sent the effects of uni¬ 
variate selection on the standard deviations and on the test correlations, we 
Shall consider the geometrical interpretation of selection in terms of the test 
configuration. In lyure 1 we have a sot of six unit to.st vectors in a con- 
hguration of two dimensions. At the start the problem will be simplified 
by letting all six of these teat vectors be of unit communality in the space of 

e two common factors, so that the diagram represents the total test space 
as well. The standard deviations of the tests are represented by the unit 
ength of the test vectors, which corresponds to the fact that 0-^=1 for all the 
trats. The test correlations are represented by the scalar products of pairs 
ot test vectors. In n dimensions we should have a test configuration which 
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is spherical, in that the disperraons have all been normalized by reducing the 
scores to standard scores. The correlations are unaffected by this standard¬ 
ization. 

Now let another group of expenmental subjects be selected so that they 
show leas variability in the direction of a selection test, L. The effect will be 
to alter the shape of the test configuration, so that it is narrower in the direc¬ 
tion of the selection test. In fact, the configuration will have an ellipsoidal 
shape, so that the configuration of two dimensions in Figure 1 will be an 
ellipse determined by the termini of the test vectors. Since the new group is 
selected so as to be more homogeneous in test L, it follows that the compo¬ 
nents in this direction of all the other tests will be affected proportionally. 
If the factor of test L is reduced in dispersion, the same factor is also reduced 
proportionally in all the other tests in which this factor enters as a compo¬ 
nent. 

Figure 1 has been drawn to repr^ent a reduction of one-half in the dis¬ 
persion of test L. The L-component of the other tests is then also reduced 
by one-half, so that the new test vectors are depressed in the direction paral¬ 
lel to test I/, as shown in the diagram. The termini of the new test vectors 
now define an ellipse instead of the circle. It should be noted that tests A 
and E are unaffected by the selection because these tests are orthogonal 
(uncorrelated) to the selection test. 

The scalar product of the unit vectors L and D is the given correlation 
rLD- This correlation is also the cosine of the angle LOI>, and it is the pro¬ 
jection of the vector D on the vector L. This is the distance DX. It is the 
component of D in the direction of L. Beducing this component by one- 
half, we have the new test vector d as shown. The length of this vector is 
the standard deviation of test D in the selected group. The new vector for 
test L is Z, which is collinear with L but only half as long. The cross product 
Id is the covariance of tests L and D in the new group. If each of these short¬ 
ened vectors, Z and d, is extended to unit length, we have the vectors L' 
and D'. It should be noted that the vectors L and L' are identical, whereas 
D and D' are not the same vectors. The correlation between two tests, such 
as C and D, is changed by the selection to a value which is the scalar prod¬ 
uct of the new vectors C and D'. 

The correlations after selection 

The effect of univariate selection on the test correlations can be shown 
vectorially. In Figure 2 let L be a unit vector representing the selection 
test in the total test space. Let J be a unit vector representing any other 
test in the battery. The components of J may be considered to be OX, 
which is orthogonal to L, and XJ, which is collinear with L. When selection 
is made on the basis of dispersion in L, the component OX of J will be un¬ 
affected, whereas the component XJ will be affected. 
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which becomes 

(7) s? = 1 

For convenience let p 2 _ ^2) then have 

(8) 2< - = gs, 

so that the new variance s’ can be written as 

(9) fi? = 1 - , 

by which the new standard deviation becomes 

(10) Si = VI- gV|, . 

The numerical values of sy can then be computed, since the coiTelations rji 
and the constants p and q are assumed to be known. 

By analogy with (3) we can write the corresponding vector equation for 
test K, and we then have 

(11) iCo — K. — tTjtiLi . 

The new covariance c,* can be expressed as the scalar product /oKo) which 
by (3) and (11) is 

(12) cjk = JoKo = (J — trjtL)(K — trtiL) ; 
and this becomes 

(13) Cj-jt = JK — trhiJJj — trjiKL + thjtrkiL^. 

Bncalling that the scalar products JK = rjk, JL=rji, KL=rM, and I/*=l, 
we get 

(14) Cjk = rjk — trjiTki — trjirki + thjiTki . 

Collecting terms, we obtain 

(15) Cjk = Tjk — Tjifkii^t — t’) , 
which, by (8), becomes 

(16) Cjk = Tjk — q^iiTki • 

This equation enables us to compute the new covariances to be expected by 
selection on test L. 
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The new correlations can be obtained by the stretching factor, which 
merely reduces the new scores to standard scores. Vectorially, this stretching 
factor is represented by normalizing the new test vectors J o and to unit 
length. Since the lengths of these vectors are known to be their standard 
deviations as given by equation (10), we have for the new correlations 


(17) 



or, in more complete form. 


(18) 


.rjib 


rsk - q-rnra 

SjSk 


where ,rjt denotes the test correlations after selection. This is Godfrey 
Thomson’s equation for the new correlations after seletition.* In computing 
the new correlations, .rjt, it should bo recalli^d that ryj = r/i = 1, because the 
present problem is concerned with the total variances of the tests. It is not 
limited to the common factors. The diagonals of the given correlations r,-* 
are unity. 

In general, the dimon.sionality of the t(.*.st configuration in the total test 
space is equal to the number of t(Wls n. When the test scores are normalised, 
each test vector is of unit length in the total te.st space, and the surface de¬ 
termined by the test vector termini is a sphere in 7i dimensions. After selec¬ 
tion on one of the tests so as to reduce the variance of the selection test L,we 
have an ellipsoid determined by the test vector teriuiiii. If the selection on 
test L is complete so that all subjects in the new group have the same score 
in test L, then we should expect to lose one dimension. The surface deter¬ 
mined by the test vector termini would then be a sphere of dimensionality 
(n—1). If n=3, the spherical surface becomes a round pancake when p is 
small and a plane when p is zero. 

"When si=p=0 so that the selection on test L is complete. The di¬ 
mensionality is then reduced to (a—1), and equation (18) becomes 


(19) 


•Tjk = Tjk. I = —7 


rjk — rjiVki 




* Godfrey H. Thomson, "The Iiiilucnoe of Univariate Soleetion on the Factorial 
Analysis of Ability,” British Journal of Vsydwlogy (Gen. Sec.), Vol. XXVIII (April, 
1938), Part IV; Walter Ijcdonnann, "Note on Professor Godfrey II. Thomson's Article 
'The Influence of Univariate Selection on Factorial Analysis of Ability,’ " British Jour¬ 
nal of Psychology (Gen. See.), Vol, XXIX (.July, 1938), Part I; Godfrey H. Thomson and 
Walter Ledermann, "The Influenco of Multivariate Selection on the Factorial Analysis 
of Ability," British Journal of Psychology (Gen. Sec,), Vol. XXIX (January, 1939), 
Part III; and Godfrey H. Thomson, The Factorial Anedysis of Human Ability (New 
York: Houghton Mifflin Co., 1939), chaps, h and xli. 
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which is the familiar partial correlation formula. If the three-dimensional 
configuration has been represented on the surface of a sphere and if the selec¬ 
tion is complete on test L, the resulting two-dimensional configuration can 
be visualized by looking at the spherical model with test vector L in the 
line of regard. The resulting two-dimensional configuration is then directly 
seen. The partial correlations would then be represented by the scalar prod¬ 
ucts of pairs of these vectors after they have been normalized in the two 
dimensions that would be seen on a photograph of the sphere with teat L at 
the center of the picture. 

It has been pointed out by Godfrey Thomson that the well-known Otis- 
Kelley formula for the effect of restricted selection on the correlation co¬ 
efficient is a special case of equation (18). In this case sy^sjb because both 
variables are then assumed to be subject to the same restricted selection. 
Equation (18) then becomes 


( 20 ) 


.Tjk 


tjh — gVftTfci 


By (10) we have, when sy=s*, 

(21) 1 - g'rj, = 1 - g*r|i , 

so that 


(22) ’■ii = »■« ; 

and hence (20) becomes 

r -. = 

(23) gi 
From (9) we have 

(24) = 1 - sj , 
so that (23) becomes 

_ fa ~ (1 ~ ^/) . 

(25) .J’y*. - ' 


and hence 

(26) 


trjksf = rjt — 1 + sj , 


so that 

(27) 


sj(l — $r/i) = 1 — r/h 



450 


MULTIPLE-1'’ACTOR ANALYSIS 


from which we have 
(28) 


1 

1 - STJ, C) ' 


wliicli is the Otis-Kellcy formula. The.se estimates of the effects of selection 
arc, of course, in the nature of expected averages, from which the selected 
samples would show random deviations. 

The communalities 

So far we have considered the effect of selection on the dispersions and 
correlations which imply the total test space. "When the communalities are 
known in one correlation matrix, the new communalities can be found by a 
sliglit adaptation of equation (18). The diagonal correlations are then writ¬ 
ten rjj=hj instead of unity. Since the selection i.s assumed to be made by 
the test scores, it follows that the uniqueness of the selection test, ns well 
as its common-factor variance, must be involved in the r&sult. 

Writing equation (18) for the communalities, where »//=/»;, we have 

(20) .rn = ./y = OV 1), 


where the denominator is written by equation (10). It should be noted that 
equation (29) applies to the computation of all the communalities, except for 
the selection test. Hence the I’cstrietion for equation (29) that 
When j = Z, Ave can write this equation in the modified form 


(30) 


tTll 


./if = 


/If - g» • r„ . M 

1 — q^rith} ' 


where one of the correlations ?•» is unity and the other is /if. Then 


(31) 


_ fefd - __ 

' ' 1 - g»/i? “ 1 - g»/if ’ 


by which the new communull ty of the selection tost can bi! computed. Jilqua- 
tion (31) may be derived vcctorially as follows: 

Let L in Figure 3 be tlic selection test veetor in the total test space, and 
lot Lr, and be the common-factor component and the unique component 
of L, so that L=Lo+L„. By selection the configuration of test vectors is 
first contracted by the proportion p in the direction of L and then normal¬ 
ized. Contracting L to pL and then normalizing reproduces L again. Hence 
the selection vector L is not altered by selection, except, of course, when 
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p=0, in which case pi becomes a null vector and the configuration is reduced 
to dimensionality (r —1). 

The length of the common factor component Lc is hi, and the projection 
of Lc on L is pL, whose length is lij. The correction vector for which is 
introduced by selection, is therefore —Ihj L, as shown in Figure S. The al¬ 
tered vector Le can now be written as 

(32) .L' = L, - th]L, 

where represents the distortion of L„ that is introduced by compressing 
the configuration in the direction of L before the vectors are finally normal¬ 
ized again. 



In order to find the length of ,Lj we write 

(33) = L» - 2mUL + . 

Since L^=l, Ll = h\‘, and, since the scalar product LoL=h„ equation (33) 
becomes 

(34) (.LO* = A? - 2tht + f^hi, 
which, by (8), reduces to 

(35) {.Ly = Mil - q%l). 
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The scalar product of ,L[ and L in IHgure S can be written either as a 
product from equation (32) or as the product of the lengths of L and ,L' 
and the cosine of their an gular separation. The length of L is unity the 
length of ,L[ is htVl—qVi’l ; and, since the cosine of the angular separation 
is aLso the projection of L on the new common-factor .space, namely, ,/i,, we 
have ’' ' 

(dll) «LJL = ,hi • /i|V^l — q^hf . 

The same .scalar prf)duct can be written by equation (32) 

(37) J4L = LLc - //ifL“, 
which becomes 

(38) J4L = hj- U4 
or 


(39) J4L = hjp . 

Eqiiating (3(1) and (39), wo get 


(40) /ifp = ,hih,V 1 - qVij ; 

and writing this expli(!itly for tho new coinmunality of the selection test, 
we have ’ 


(31) 



- qVi}' 


as previously written. By this equation the now communality of the selec¬ 
tion test can be computed. 

In^solving a complete problem of this kind it is convenient to use God- 
fiey Thomsons equation (18) for all the new correlations, including the 
communalities, except that of the selcislion test, for which equation (31) 
applies. 

Computational sequence 

The problem of determining the effects of univariate selccition starts with 
the correlation matrix and the communalities, as well os the degree of selec¬ 
tion on the selection test, which is denoted L with subscript 1. It is assumed 
that the given scores have been standardized so that ffj = 1 for all tests. The 
selection of a new group is such that the standard deviation of the selection 
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test is chSinged from, the given value ci=1 to ai new value, si, which is known, 
The ratio of the standard deviations is 



V, 


where p is a parameter that determines the new factorial results. The fol¬ 
lowing convenient constants are then computed: p*, g* = 1—p®; and q. 

The given correlation matrix is written with unity in the diagonals. 
Equation (18) can be written in the form 


(41) Ji:. = MCM = M{R - UU')M, 


where R, denotes the expected correlation matrix after univariate selection. 
The matrix Z7 is a column vector with elements Uj=grji, and the matrix M 


Table S 

Gwen Corrdation Matrix R, 



1 

a 

a 

4 

6 

6 

7 

s 

D 

10 

1 

1.000 

.000 

.000 

.350 

.606 

.350 

.606 

.000 

.000 

.404 

2 

.000 

1.000 

.000 

.606 

.350 

.000 

.000 

.360 

.606 

.404 

3 

.000 

.000 

1.000 

.000 

.000 

.606 

.350 

.606 

.350 

.404 

4 

.350 

.606 

.000 

1.000 

,606 

.176 

.303 

.303 

.525 

.552 

5 

.606 

.350 

.000 

.606 

1,000 

.303 

.526 

.175 

.303 

.552 

6 

.350 

.000 

.606 

.176 

.303 

1.000 

.606 

.525 

.303 

552 

7 

.606 

.000 

.350 

.303 

.625 

.606 

1.000 

.303 

.175 

.552 

8 

.000 

.350 

.606 

.303 

.175 

.625 

.303 

1.000 

.606 

.562 

9 

.000 

.606 

.350 

.525 

.303 

.303 

.175 

.608 

1.000 

.662 

10 

.404 

.404 

.404 

.552 

.552 

.552 

.552 

.552 

.662 

1.000 


is a diagonal matrix with elements dj=l/sj. Equation (41) indicates the 
computational order. One may compute, fii’st, the column vector U, then 
the covariance matrix C = UU' of order nXn, and, finally, R,. The correla¬ 
tion matrix R, is, of course, symmetric, and it also has unity in the diag¬ 
onals. 

When the correlation matrix R, has been computed, the communalities 
may be computed separately by equation (36), where it must be remembered 
that ru is written as hi. 

Examples of upivariate selection 

The principles of the preceding sections will be illustrated by a numerical 
example with a physical model. A variant of the box problem will be used. 
The factor matrix of Table Jf. represents ten measm'es of the box problem, in¬ 
cluding the basic parameters, height, width, and length, and such other box 
measurements as the diagonal of each face, the area of each face, and one 
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complex meiiHure, such us the volume. In order to illustrute thp off * , 
selection, the given example in Table arranged to represent the S- 
in which the three basic parameters are imcorrelated. Further in wdeiT 
•show the effect of .selection on the communalitics, the.se have b 
m the factor matrix as markedly below unity, namely 70 for all ten 


Table /, 

(liven Factor Matrix Eo 



I 

II 

III 

1 

.265 

-.270 

.540 

2 

.542 

.632 

.047 

S 

..542 

-.424 

-.473 

4 

.620 

.448 

.313 

n 

P) 

.506 

.620 

.116 

-.519 

. <555 
-. 16.5 

7 

.,560 

-.514 

.2.57 

8 

.7.10 

-.0,51 

-. 380 

0 

.740 

.336 

-.10.5 

10 

.815 

-.024 

.047 


Table r, 

(lontpulalion of hj 


1 

2 

3 

4 

b 




1.000 

.000 

.000 

.350 

.000 


0 

7 

8 
0 

10 


.3,50 

.000 

.000 

.000 

.404 


vn 

7V}| 

*/ 

.800 

. 640 

.360 

.000 

. 000 

1.000 

.000 

.IKK) 

1.000 

.280 

.078 

.922 

.485 

.235 

.765 

.280 

.078 

.022 

.485 

.235 

.765 

.000 

.000 

1.000 

.000 

.000 

1.000 

.323 

. 105 

.890 


"I mj 

.000 1.007 
1.000 J.OOO 
1.000 1.000 
.000 1.042 
.375 1.1.14 

.900 1.042 
.S7.5 1.144 

1.000 1.000 
1.000 1.000 
.046 1.0.57 


/) = .()0 
30 

7= = .04 
7 = .80 
1 = .40 
f= = .lG 
«?=1-7V?, 

7® = ! —n» 

< = 1-7J 


Ui ^i/rn 
W,=l/S/ 


viatieu s (iO in th 1- «« that it.s standard de- 

latioi 5ip n-i 1 ‘^ti„n instead of unity, iw in the given popu- 

0 Sata z „„ rr “i “7“*“*” »» 

have the detailed computations for the new standard 
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deviations sj and the reciprocal my. The computations of this table are de¬ 
termined by equations (9) and (10). 

The new covariances after selection are determined by equation (16), 
which can also be written in matrix form, as shown in Table 6, The entries 
in this table are the cross products of the new scores, whose standard devia¬ 
tions have been depressed. Hence these entries are not correlation coeffi¬ 
cients. The diagonal entries are the new variances of the tests. The corre- 


Table 6 


Covariance Matrix Ca = Ri — UU' or Ca = fjv — ujuk 



1 

2 

3 

4 

5 

6 

7 

8 

0 

10 

1 

.360 

.000 

.000 

.126 

.218 

.126 

.218 

.000 

.000 

.146 

2 

.000 

1.000 

.000 

.606 

.350 

.000 

.000 

.350 

.606 

.404 

3 

.000, 

.000 

1.000 

.000 

.000 

.606 

.350 

.606 

.350 

.404 

4 

.126 

.606 

.000 

.022 

.470 

.097 

.167 

.303 

.525 

.462 

5 

.218 

.350 

.ooa 

.470 

.765 

.167 

.290 

.175 

.303 

.395 

6 

.126 

.000 

.606 

.097 

.167 

.922 

.470 

.526 

.303 

.462 

7 

.218 

.000 

.350 

.167 

.290 

.470 

.766 

.303 

.175 

.395 

8 

.000 

.350 

.606 

.303 

.175 

.525 

.303 

1.000 

.606 

.552 

g 

.000 

.608 

.350 

.625 

.303 

.303 

.175 

.606 

1.000 

.552 

10 

.146 

.404 

.404 

.462 

.365 

.462 

.395 

.662 

.562 

.896 


Table 7 


New Correlalion Matrix Ra = MCaM 



1 

2 

3 

4 

6 

6 

7 

8 

e 

10 

1 

1.000 

.000 

.000 

.219 

.416 

.219 

.416 

.000 

.000 

.256 

2 

.000 

1.000 

.000 

.632 

.400 

.000 

.000 

.350 

.606 

.427 

3 

.000 

.000 

1.000 

.000 

.000 

.632 

.400 

.606 

.350 

.427 

4 

.219 

.632 

.000 

1.000 

.660 

.106 

.199 

.316 

.547 

.608 

5 

.416 

.400 

.000 

,660 

1.000 

.199 

.379 

.200 

.347 

.478 

6 

.219 

.000 

.632 

.106 

.199 

1.000 

.660 

.647 

.316 

.608 

7 

.416 

.000 

.400 

.199 

.379 

.660 

1.000 

.347 

.200 

.478 

8 

.000 

.350 

.606 

.316 

.200 

.647 

.347 

1.000 

.606 

.583 

9 

.000 

.606 

.360 

,647 

.347 

.316 

.200 

.606 

1.000 

.583 

10 

.256 

.427 

.427 

.508 

.478 

.608 

.478 

.583 

.583 

1.000 


spending correlation coefficients are shown in T<Me 7, and these represent 
Godfrey Thomson’s equation (18) with unit diagonals. They can be ob¬ 
tained from the covariances of Table 6 by the stretching factors m>=l/sy, 
which are the elements of the diagonal matrix M. This matrix is identical 
with the table of covariances, except for the fact that the standard devia¬ 
tions have been stretched to unity. 

The new communalities are determined by the detailed calculations 
shown in Table 8 from (36), in which ru is written as hi. Finally, when the 
new correlation matrix with communalities in the diagonal cells is factored, 
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we get the new factor matrix /■’„ aw shown in Table 0. Here the nnmk , 
factors 13 again tlirec, as in tlie given correlation matrix, thus verifyin^SJ^ 
frey I homsons theorem that the rank of tl.e correlation matrix 2?° 
munahties remains unaltered with univariate selection Ilowevo/ 
ception should be mentioned. In complete or bdal univariate .sclectioror 
fcaetor or its equivalent~a test with perfect (■<miinunality-tho new stan 7 
ard deviation of the selection test or fa,dor is xero, and the rank oflt n 
correlation matrix has tlum been rcduc,*d Iiv ] In ‘ 

rank of the new correlation matrJ::^::; » 

showm ‘ tilts type will ako be 

Perhaps the most important consideration in this problem is to nsnopto- 
wlmt happens to the WenlKhation of the pri,„„y taeto“ Tr 


Table S 

Nm Conimumliliea; lii} 


M-qM. 

1 - qVJi 


1 

2 

3 

4 
6 
U 

7 

8 
<J 

10 


Table 0 

New Factor Matrix P, 


'll 


'll 0^11 Nuni, Drnoiii. ,*,* 


■700 .837 .700 
.700 .000 .000 
.700 .000 .000 
■700 .120 .010 
■700 .218 .048 
■700 .120 .010 
■700 .218 .048 
■700 .000 .000 
■700 .000 .000 
■700 .140 .021 


.448 .202 
■000 .700 
■ (K)0 .7(K) 
■010 .600 
■031 .670 
■010 .600 
.031 .070 
■000 .700 
■000 ,700 
■014 .686 


■ f,S2 .<lf,7 
1.000 . 7(K) 
l.OOO .7(K) 
.9(H) .607 
■070 .691 
.990 .697 
.970 .691 
l.OOfl .7(H) 
1.000 .7(H) 
.986 .606 



I 

11 

in 

1 

.334 

-.340 

.088 


.644 

.034 

.048 

3 

.543 

-.425 

-.474 

4 

.638 

.370 

.386 

5 

.561 

.023 

.610 

6 

.637 

-.538 

-.067 

7 

.561 

-.507 

.359 

8 

.742 

-.001 

-.387 

9 

.742 

.337 

-.196 

10 

.820 

-.075 

.151 


vectors ^so tS t!^ (4 T '’«P‘’eee“ted by the methed of extended 
The Eiven no-sif configuration can be .seen in a plane. 

S b A glanof aTtIds f " test vectors arc denoted o, and the new positions 

able I reSns uLl 11 S' t«®^°«tion vari- 

thc selection test. These am tostf? 9 with 

The other * ' / ° 011(1 J. Ihe.se remain unaltered. 

from the scifK.f * “inovo in a dirocstioii radially 

tained Iii the nrestmt" S" th“;t tbc triangular conligiiration is still re¬ 
remain uLltoi T climemsiuns of the triangle even 

ed with the two cor. 'r "' If two inve.stigators start- 

SeXr 2 rin 7 l“'«t group of objects and 

the same siin 7 ^ t ^ selected group of objeet.s, they would arrive at 

mple structure, and they would identify the same primary fac- 
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tors or parajneters. Hut their results would differ ss to the correlations be¬ 
tween the meaauremtots with which they started. In the present example 
the correlations between the primary factors would remain the HB.Tnp. for the 
two groups of objects. Variations of these principles will be shown in addi¬ 
tional examples. 



The most important principle to be drawn from analyzing the effects of 
selection on factorial results is that under wide variations in the conditions 
of selection the simple structure is invariant, so that the primary factors or 
parameters are the same. The correlations of primary factors are altered 
from one selected group to another. A simple example will serve to illus¬ 
trate this principle, which is well known in other contexts. The correlations 
between height, weight, and intelligence can be made to take widely differ¬ 
ent values, depending on the selection of the experimental group. If chil- 
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dren of ages and stafcurea are included, then the co.T^i..f; , 
stature and intelligence will be found to be appreciable 'nl ' f 
not spurious It is correct to say that there actually is a high’(wS°t-“ 
between intelligence and stature for any experimental non Sr 
dreii with a wide range in Humologicafage The t^^^ 
orally older, and they score higher on the tests If the evn 

Sm™ vaiimte, or nearly m. Tlio iiilar|),-et„ti„„ ie „„t to deny 11^!. * 

of the viiruLblOiS or the fju'toix 'PlmcA >iwi <i " y ^hc mGaning 

and test score for the two glnl it is^ mmureinents of stature 

that are altered by the selective conditions"^"!!'! th^bov 
seen that the correlations between iSTwhItl ^ 

can be altered by the selection of each coll’cction of boxi"?ut "the 
interpretation of the three parameters remains nrcc s!S iT ^ 
several box collections. We dwell on this point in dot-iif 
source of misunderstanding of the factorial methods in il f 

ot factors, as distinguislied from selection by inls The Xir ‘ 
tors for the box problem may be denotedT Ld p T 

SfbT"“ «“ Sn-oo 

to on onto r sr/r 7,-“' “"™ 

the now™ Sbia 

obo^ by «r^n,„o,5E;ir;,T^^^^^^^ 

fundamental theory on the problem of unU 

to whether the primary factors can bo intnr " !” expressed doubt os 

processes. His reason Is mainly that tlio iiiontifiablo psychological 

simple structure are altocKndlt^ntT? “‘‘'T ’’‘"'r'''" “ 

further, that Incidental factors can ho added bv '/""‘htions of selection and, 

tion. Our interpretation is that the nrimarv '>f multivariate selec 

dilTeront conditions of selection and that iUa Hm™ '''*^’[■‘'‘''““<1 thu same basic processes in 
that are altered rather tS the fi, SI f 'mtween these parameters 

tiona of particular experimenta^Sl?„v* ‘I'® '“"di- 

charaeteristios that Se b ^ sirnwri 

Godfrey Thomson's theoreS^wSrl Presenting 

mistio interpretation of the factorial resulte.*^ Problem, we are giving a less pessi- 
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arc denoted lx, 2x, 3x, etc. This set of six diagrams was designed by Led- 
yard Tucker to show graphically the effects of various conditions of uni¬ 
variate selection on the test configuration. 

Figure S shows the effect of partial selection on the factor P.. Note that 
the position of the selection variable S=l = lx remains unaltered. The po¬ 
sitions of the test vectors 2, S, 8, and 9 remain the same because they are 
uncorrelated with the factor Pi. The other test vectors move radially from 
the selection variable S, as shown in the triangular configuration. The sim¬ 
ple structure is unaltered. In the same figure we have a diagram showing 
the effect of total selection on Pi. This means that all the boxes in the new 
box population have the same height. The individual box shapes will be 
determined by only two parameters, since one of the parameters has be¬ 
come a constant and does not affect the individual differences among the 



objects. Therefore, we expect the factorial result after selection to be of 
rank 2. This is verified in the diagram, which was plotted after making the 
computations that have been explained. The variable 1 disappears from 
the second analysis because it is a null vector. This is what happens occa¬ 
sionally when the communality of a variable turns out to be v anishing ly 
small. It usually happens when the corresponding correlations are also 
small. The new configuration lies entirely in the base line of the figure, 
which represents only two dimensions. 

If an investigator were to make a factor analysis of such a collection of 
boxes, he would find only two factors. If he were to plot the resulting con¬ 
figuration, he would get a simple structure, as shown in Figure 6. Here we 
see that, even though one of the three factors has been entirely eliminated 
from the individual differences and from the analysis, the same simple 
structure is identified for the remaining two factors. The interpretation of 
the two primary factors, width and length of boxes, is the same in the two 
box populations. 
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Figure 7 was drawn to show the effect of univariate selection on the com¬ 
posite variable (Pj-I-Pa). The first diagram shows the effect of partial selec¬ 
tion on this composite variable, which is denoted S. The given configura¬ 
tion of ten vectors is shown on the inside triangle, which is identical with 
that of Figure 6. The effect of selection is to move the termini of the test 
vectors radially from the selection vector to the new positions, denoted lx, 
2x, Sx, etc. The variable l = lxis unaltered because it is orthogonal to the 
composite variable S, The others move a.s shown by the radial lines from S. 
The new configuration shows the same simple striic.ture as before, with the 
same primaiy factom in the tests 1, 3, 3. Hence the interpretation of the 
primary factors would be the same as before selection. The correlations be¬ 
tween the primary factors have been altered. 



In the second diagram of Figure 7 we have the effect of total selection on 
the composite variable 5= (I’s-bPa)’ Here we start, os before, with the 
given triangular configuration of ten test vectors e.xtended to the tangent 
plane. The new configuration, after selection on S, is of two dimensions, as 
is to be expected after complete selection on a factor. The new configuration 
is indicated along the upper horizontal line of the diagram. Tests 3x and 
9x are orthogonal to test 1, and so are also tests Sx and Sx. If an investi¬ 
gator were to start with the selected box population and proceed with a 
factor analysis, he would find only two factors in this case. The configura¬ 
tion that he would find is shown in Figure. 3, wliere it will bo seen that 
the simple structure is again the siune for the two factors that remained 
in the system. The primary factora are again identified by test 1 and the 
combination of tests 2 and 3. The physical interpretation of the factor Pi 
would be the same as before. The interpretation of factors P® and Ps would 
be obscured because tlie investigator would supposedly not know that he 
was dealing with a freak collection of boxes, which had been so selected that 
the sum of the width and length of each box was the same for all. In the 
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Brst diagi'iiin of Figure 7 it is seen thiit with partial selection this ambiguity 
does not arise. 

We turn next to an even more stringent selective condition, namely, the 
composite variable S={Pi+P 2 +Pa) ■ This is the sum of the three box di¬ 
mensions. In Figure 9 the inside triangle shows the given configuration as 
before. The composite variable S is in the middle of the configuration at 
test 10. The new configuration, after partial sele(!tion on the composite 
variable S, is shown by the outside triangular configuration. The new test 
vectors all lie in the outside triangle, and their locations are determined by 
the radial lines from the selection variable as before. It can be seen that the 
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simple structure is here again retained after selection and that the primary 
factors are the same, namely, those which are determined by tests 1,2, and 
S. Hence wo conclude that partial selection on a linear combination of even 
all the factors leaves the simple strucsture, as well as tho physical interpreta¬ 
tion of the primary factors, invariant. 

However, if tho boxes are assembled so as to satisfy tlie conditions of total 
selection on tho composite variable S, then tho rank is reduced to 2; and in 
Figure 10 we have tho plot that an investigator would make with the new 
configuration. Here it is seen that the simple structure has been destroyed, 
so that the primary factors are no longer identifiable. We conclude, there¬ 
fore, that conditions of selection can be made so extreme that the simple 
structure is destroyed. In such a population the primary factors cannot be 
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detennitied. In this case we should be dealing with a sot of boxes so selected 
that the sum of the three box dimensions was the same for every box in the 
collection. For partial selection, as shown in Figure 0, the simple structure 
remains invariant. Hence we conclude that it is the total selection on this 
composite variable which destroys the simple structure. 

Multivariate selection of subjects 

So far it has been assumed that the selection of subjects is determined by 
their homogeneity in a single criterion variable, even though this variable 
is itself a linear combination of .several factors. Selection of subjects can be 
made to depend on several variables, with the re.striction that the intercor¬ 
relations of these variables must have certain pre-scribed values. In these 
cases it may not be possible to describe the correlations in the selected group 
as an alteration in the homogeneity of a single variable, not even a composite 
selection criterion. We then have rnuUimriale seleciian of .subjects. However, 
multivariate selection can be described in terms of suc(^e.ssive univariate se¬ 
lection by the formulae already di.scM!<.scd, provided that the .successive vari¬ 
ables are properly chosen. This pi-oeedure will be illustrated by a numerical 
example that has been used by Godfrey Thom.son in his di.scussinns of multi¬ 
variate selection.* 

In analyzing multivariate H<ilecti(m it is convenient to divide the vari¬ 
ables into two groups, namely, tho.so which arc direc^tly involved in the selec¬ 
tion and those which are not dirc<‘.tly involvc<l. Tlus former, by which the 
selection is determined, will bo denoted by substaipt j and the others will be 
denoted by subscript k. The given correlation matrix (san then be sectioned 
in the following manner: 


Ru 

Rjk 

Ihi 

Rtk 


The correlations of the selection tests are shown in section /i,-,- before selec¬ 
tion. The correlations of the same tasts after selection may be symbolized 
by the matrix Vjj, which shows the new correlations that are imposed by 
selection. The now correlation matrix can then be syinb(dizcd in sectioned 
form as follows: 







* The Factorud Analysis of Human Alnlily, p. 187. 
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which represents the correlations to be expected after selection. The diag¬ 
onal elements of Vjj show the new variances of the selection tests, and the 
side entries of Vjj show the covariances to be imposed by selection. 

The problem is, then, to determine the expected correlations in the sec¬ 
tions Ykh and 7,-*, which is the transpose of 7^. A formal matrix solution 
to this problem has been written by A. C. Aitken and reported by Godfrey 
Thomson.* The solution is as follows: 

(42) yjk = VjiRr^Rj,, 

(43) Vkb = Rkb - - Rr^VjjRTj^) Rib , 

(44) 7„ = 7;*. 

Godfrey Thomson’s numerical example will be used for the present dis¬ 
cussion to illustrate the analysis of multivariate selection in terms of suc¬ 





Table 10 

Gioen Corrdalion Matrix 




Table 11 

Given 

Factor 

Matrix 


L 


1 

2 

s 

4 

6 

6 


I 

L 

1.0000 

.0000 

.8741 

- .3741 

,0936 

.0802 

.0668 

.0534 

1 

.0 

M 

.0000 

1.0000 

.0274 

.0274 

.6416 

.6600 

.4683 

.3667 

2 

.8 

1 

.3741 

.9274 1.00 

.72 

.63 

.64 

.46 

.36 

3 

.7 

2 

- .3741 

.0274 

.72 

1.00 

.66 

.48 

.40 

.32 

4 

.6 

3 

.0035 

.6416 

.63 

.56 

1.00 

.42 

.36 

.28 

6 

.6 

4 

.0802 

.5500 

.64 

.48 

.42 

1.00 

.30 

.24 

6 

.4 

5 

.0668 

.4583 

.46 

.40 

.35 

.30 

1.00 

.20 



6 

.0534 

.3667 

.36 

.32 

.28 

.24 

.20 

1.00 




cessive univariate selection. His numerical example is reproduced in the 
correlations between the six numbered variables of Table 10. The columns 
L and M have been added, and they will be described presently. The pven 
correlation matrix is of order 6X6, and it is of unit rank. The corresponding 
one-column factor matrix is shown in Table 11, In order to illustrate multi¬ 
variate selection, Thomson imposes a change in the variances of tests 1 and 
2 and also in the covariance cu. The given section of the correlation matrix 
for these two variables is 


1 


2 


1 2 


1.00 

.72 

.72 

1.00 


* p. 189. 
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where the unit diagonals represent the unit variances of the tests at the 
start and where the given correlation ris=.72. This section of the correla¬ 
tion matrix is to be changed by selection to 


1 

2 


where the two test variances are depressed to . 36 and the covariance to 
cia= .30. The problem is now to determine the expected covariances in the 


M 



rest of the 6X6 matrix and then to factor the corrc.'<i«iiuling correlation 
matrix. The direct method of Aitkcn can he u.scd to solve the problem. It 
can also be represented im a form of Huc<!o.s.sivc univariate selection. 

In Figure 11 the two unit vectors, Ti and Ti, represent the two te.Hts 1 and 
2. They have been drawn so that the eoaino of the angular separation is 
.72, which is the given correlation ri*. The relation between these two tests 
which is imposed by .selection is shown by the two vectors T{ and Tg, with 
lengths of .60 and scalar product of .30 a.s required by the new matrix 7,/. 
The two configurations have been ai-ranged in Figure 11 to utilize the sym¬ 
metry in this cose in order to simplify the transformation from one to the 


1 2 


.36 

.30 

.30 

.36 
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other. The new orthogonal selection variables ai-e drawn in the figure, name¬ 
ly, L and M. 

The transformation from the given configuration to the new configura¬ 
tion can be expressed in terms of two successive univariate selections, first 
on il4 and then on L, The first selection on M is specified by the restriction 
that 


.5744 
^ .9274 


.6193 , 


so that the new vectors become (Ti~A) and {Ta-A). Then follows a uni¬ 
variate selection on L, with the value 


.1732 _ 
3741 


.4630, 


so that the new vectors become 


(45) T[ = (T^-A-B), 

(46) n = {T,-A + B), 

which define the new configuration and the covariances. 

The first step is to add two rows and columns to the given correlation 
matrix for L and M in Table 10. The unit vector M bisects the angle be¬ 
tween Ti and Tt, so that we can write 


(47) 

M = CiiTi + Ti ). 

Hence 


(48) 

rjm = Ci(ryi -1- r/i ), 

where 


(49) 

1 

V2(l + m) ■ 


In the same manner the unit vector L is a linear combination of Ti and T a, 
orthogonal to Af, so that 

(50) L = cs(Ti — Ti) ; 


and hence 
(51) 


Tjl = CiCrjl - Tji) , 
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J._ 

V2(l - r,*) ■ 


Having thus determined the correlatioiis of the six tests with L and M in 
Table 11, we determine the new covariances after selection on M. These co- 
variances are shown in Table 12. The covariances after further selection on 
L are then computed in the same manner, and those arc listed in Table 13. 
It is not necessary here to express TMe 12 in the form of correlation co¬ 
efficients. 

Talk IS 

Covariance Matrix after Sekdim on M 



L 

M 

1 

2 3 4 

6 

0 

L 

1.0000 

.0000 

.3741 ■ 

-.3741 .0935 .0802 

.0008 

.0,534 

M 

.0000 

.3835 

.3557 

.3557 .2460 .2109 

.17.57 

.1400 

1 

.3741 

.3657 

.4090 

.1800 .2032 .2255 

.1880 

.1.504 

2 

- .3741 

.3667 

.1800 

.4099 .1932 .1055 

.1380 

.1104 

3 

.0936 

.2460 

.2032 

.1032 .7402 .2024 

.1087 

.13.50 

4 

.0802 

.2109 

.2255 

.1055 .2024 .8135 

.1440 

.11.57 

5 

.0608 

. 1757 

.1880 

.1380 .1087 .1440 

.8705 

.0904 

0 

.0534 

. 1400 

. 1504 

.1104 .1350 .1157 

.0004 

.0171 


■ 574 4 
.9274' 


.6193 


p’=.3835 
9>=>.01G5 
q = .78.')2 


Talk IS 

Covariance Matrix after Selection on L 



L 

M 

1 

2 

.S 4 

0 

L 

.2145 

.0000 

.0802 - 

-.0802 

.0200 .0172 .0143 

.0110 

M 

.0000 

.3835 

.3657 

.3657 

.24(«) .2109 .1757 

.1400 

1 

.0802 

.3667 

.3599 

.2009 

,23.57 .2019 .1684 

.1347 

2 

- .0802 

,35.57 

.2909 

.3.599 

.2207 .1891 .1570 

.1261 

8 

.0200 

.2460 

.23.57 

.2207 

.7303 .1005 .1638 

.1311 

4 

.0172 

.2109 

.2019 

.1891 

.1965 .8084 .1404 

.1123 

6 

.0143 

.1757 

.1084 

.1576 

.1038 .1404 .8670 

.0936 

6 

.0115 

.1406 

.1347 

.1201 

.1311 .1123 .0036 

.9149 


.1782 


.4630 


..7850 

..8803 


In Table 14 are recorded the correlation (ioeflic.icnts corresponding to the 
covariances of Table IS, and in Toblc 15 we have tlio final factor matrix 
after selection, which is also represented in Figure 12. It will be seen that 
the final factor matrix is of unit rank, except for the doublet factor in the se¬ 
lection testa 1 and 2. The nature of this doublet factor is explained in Ta¬ 
ble 2 at the beginning of this chapter. The additional test i.s there a linear 
combination of the first two tests of the battery. Here the same effect is 
shown because the two unique factoi’s have been introduced into the com¬ 
mon factors to become an incidental common factor. The multivariate se¬ 
lection with the restriction that the new correlation rj* shall have an arbi- 
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trarily chosen value of = .83 introduces an incidental factor, namely the 
doublet factor II in Table 15. This introduction of an incidental factor’into 
the common factors has not disturbed the single common factor, I, -with 
which the problem started in Tables 10 and 11. The saturations of the fac¬ 
tor I have been altered, but not its identity. 

Summary 

Since factor analysis starts with a set of measurements for each individual 
member of an experimental group, it is evidently of fundamental significance 

Table 14 Table IB 


New CorrelaHon Mairix New Padm Matrix 



1 

a 

3 

4 

s 

6 


I 

II 

1 

.87 

.83 

.46 

.38 

.30 

.24 

1 

.82 

.46 

2 

.83 

.78 

.43 

.35 

.23 

.22 

2 

.76 

.45 

3 

.46 

.43 

.31 

.26 

.21 

.16 

3 

.56 

0 

4 

.38 

.36 

.26 

.21 

.17 

.13 

4 

.46 

0 

5 

.30 

.28 

.21 

.17 

.14 

.11 

5 

.37 

0 

6 

.24 

.22 

.16 

.13 

.11 

.08 

6 

.20 

0 


JT 



to know how the factorial results are affected by the manner in which the 
experimental individuals are selected. To the extent that a simple structure 
and its associated primary factors are invariant under changes in selective 
conditions for the experimental group, we can have confidence that the 
primary factors represent identifiable processes whose nature transcends the 
circumstances under which the experimental subjects happen to be selected. 
It does not follow that these identifiable and interrelated processes are 
therefore unique in the mathematical sense of being the only set of parame¬ 
ters that can be used for describing the dynamic system that produces the 
observed individual differences. The invariance of simple structure under 



470 


^IULTIPLK.KA(TOR ANAIA'SIS 

changes in sdcctive (.■(nidit.inns (Uws imply, Iifavuver, flmt th(! processes sn 
identified are likely to lie fruitful liimlmiirks in a logical dericrintion of 
system. 

By unmirialc Hekdion is iiieant the seloclion of a Kroup of experimental 
wiibjetjt-H so that tlasir standard dcvialion in a srlortion vuriablo sliall be dif 
fereiit from unity, wldeli is the dispersion in a.sel of normalized’seores for an 
initial Ktoup of .subjects. Tlie criterion or selection variable may he defined 
by one of the te.st.H in the battery, or it. may lie ii linear eombiiiation of sev 
oral te.st.s or factors of tlie initial analy.sis. If the selection criterion i.s corre- 
lated with any of the te.sts in the battery, then there will be an effect on the 
eorrclations between the tests in the selected Rroiip of siihjeet.s The ex 
peeted (lomilations in the now Kroup can he computed by CJodfrcy Thom- 
.stm’s tupiation (18). The new coinimmalities can ho detorminod in an 
analogous mannor. 

vyheii tho now group of sulijocls Is asseiubletl according to dispersion in 
a .seleetioii variable L, m that its .stuiularil deviation si .satisfies the in¬ 
equality tlien tlie newgnmp i.sassemlded hy pridinl i^drdwn in the 

.souse tdiai, varianoe in the selection variable is not entirely exeludod; but 
it is dmeront from that of tlm initial group of siilijeets. Wlien I ho new irrmiD 
IS assomblccl so that its dispersion in the .selection variabh* vanishes entire- 
ly, then its standard deviatioti and the now grouii is then deseribod by 
complck or tolnl Hdedion on tlio .selection variable, 

The rank of the reduced correlation matrix for tlie new group is tho .same 
03 for tlm initial group of .subjects, exeept wlioii the selection is complete 
on the selection variablo. in wliii-h eiuse the dimensinmility i.s ivdueed by 1. 
We then have first-order partial isirrehition eoeflieients, witli the selection 
variable <!on.stant, and tlio rank r is then redu(*cd to (r— 1) 

In partial selection when the rank of the reduced correlation matrix is 
invariant, the simple structure is also invariant, but the correlations be- 
woen the primary parameters are altered. Tho interpretation of the pri¬ 
mary factors remains the same in both groups. 

In total .selection, when the rank of the reduced correlation matrix is re¬ 
duced by 1 the .simple .structure may he di.storted, depending on the rela- 

nr,/n! T 1 tlie primary factors. Tlie interpretation of the 

p.imaiy factors affected by the total selection may then be obscured. 

ni.iwl . 1 ^ RKJ'ip iH selected so !us to .satisfy conditions on two inde- 
Su Id It t'"' -sHection variables are af- 

i Mnu-*’ T?’ ‘"’'“•I' "Hituution is called viullivariale se- 

vni-info « I described in terms of .successive uni- 

V latc selections The expcc.tcd correlations after multivariate selection 

tTnns^^ derived by Aitken. The new eorrela- 

! nnPoT + ^determined by the univariate formula of Godfrey Thomson 
applied to represent .successive univariate selections. 
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With partial multivariate selection of a new group of subjects, the rank of 
the reduced correlation matrix is augmented by one or more incidental fac¬ 
tors. The number of incidental selection factors is determined by the num¬ 
ber of independent variables that participate in the multivariate selection. 
The simple structure remains invariant, so that the primary factors can. be 
identified with the same interpretation as for the initial group of subjects. 
The additional factors may show appreciable variance, but they will not be 
invariant for differently selected groups, since they are determined by the 
conditions of selection of each group. If the attempt is made to interpret the 
incidental selection factors as basic parameters, then the interpretation will 
fail to be sustained in subsequent factorial studies of the same domain with 
differently selected subjects. The primary factors should be identified in 
the differently selected groups. 

With total multivariate selection the rank of the correlation matrix is re¬ 
duced by one or more factors, which depend on the number of successive 
variables on which the selection is complete; but the rank is also augmented 
by incidental selection factors, which depend on the number of variables 
that participate in the selection. With total selection involving the primary 
factors, the simple structure can be so distorted that the primaries may not 
be identified. For this reason it is well to allow as much variation as possible 
among the subjects in the domain to be investigated, thus practically elimi¬ 
nating the possibility of total selection within the parameters that are to be 
sought. In factorial investigation it is not of any consequence whether 
any of the groups of experimental subjects are representative of a general 
population. The important consideration is that the experimental subjects 
should vary among themselves as much as possible within the domain that 
is being investigated. 

The analysis of these various cases of selection is very encouraging, in 
that a simple structure has been shown to be invariant under widely differ¬ 
ent selective conditions. Hence the scientific interpretation of the primary 
factors as meaningful parameters can be expected to transcend the widely 
different selective conditions of the objects that are measured and factorially 
analyzed. This encouraging finding leads to a recommendation for the fac¬ 
torial study of any domain. When a simple structure has been found for 
a test battery that has been given to an experimental population and when 
a plausible interpretation of the primary factors has been found, these 
should be regarded as hypotheses to be verified by giving the same test bat¬ 
tery to new experimental populations that should be selected in different 
ways. If the primary factors are in the nature of basic parameters that are 
not merely reflections of the experimental conditions or the particular se¬ 
lective conditions, then these factors should be invariant under widely dif¬ 
ferent selective conditions, and their interpretation should be the same for 
the several experimental groups. New test batteries should be constructed. 
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with prediction as to factorial coiuptwition of the now tests, and these should 
be tried on differently selected subjects in order to determine whether the 
interpretation of each factor as a meaningful pai-ameter can be sustained 
This is another situation in which the factorial methods depart from the 
conventions of statistic,al analy.si.s. It is cu-stoinary in .statistical reasoning 
to think of a general population from whicii we merely draw samples and 
the Avorry is then whether the sample is really representative of the uni- 
voree. In factor analy.sis the principal concern is to discover an underlying 
order to be described in terms of meaningful parameter which .should repre¬ 
sent scientific concepts. The validity of a primary factor is determined by 
its fruitfulness as a scientific concept. It is iiuulequate if it serves merely os 
a regrassion coefficient. When factor analysis luus completed its job of 
charting a new domain, then it may be of praifticul importance to establish 
norms of performance for any specified general population. Then the con¬ 
ventional statistical reasoning is again applicable. 



CHAPTER XX 
THE PRINCIPAL AXTO 


Indirect solution 

When multiple-factor analysis was first developed, it consisted essen¬ 
tially in a shift of emphasis. The dominant question in previous factorial 
studies had been as to whether the correlations could be accounted for by a 
single general factor and whether the general-factor residuals were large 
enough to justify the recognition of “disturbers,” which were called “group 
factors.” These were sometimes frankly admitted at the start of a study, 
but always with the reservation that they should be regarded as secondary 
to the general factor, which was invariably postulated. With multiple- 
factor analysis the fundamental question was formulated without this re¬ 
striction, namely, to determine how many factors were indicated by the ex¬ 
perimentally given correlations. When that question was answered, the 
next question was naturally to inquire about the nature of all the common 
factors that determined the correlations. This extension of the factor prob¬ 
lem to any number of dimensions made it a question of fact as to whether 
one or more of the common factors were general in the sense of participating 
in the variance of every test in the battery. 

One of the early objections, raised by Spearman, against multiple-factor 
analysis was the indeterminacy of the problem when more than one factor was 
indicated by the correlations. In theauthor’sinitial papers describing themul- 
tiple-factor approach, this indeterminacy was shown to be associated with 
the question of where to locate the reference frame in the test configuration. * 
The number of dimensions of that configuration was shown to be equal to 
the rank of the table of correlation coefficients, which was defined as a square 
symmetric matrix.! 

In the author’s first papers on multiple-factor analysis the indeterminacy 
of the location of the reference frame was resolved by placing the first refer¬ 
ence axis BO as to maximize the sum of the squares of its factor loadings. J The 
next factor axis was located in the same manner by the first-factor residuals, 
and so on until the r principal-factor axes had been determined. Each suc- 

♦L. L. Thuratone, “Multiple Factor Analysis," PsyMogicd Eeview, XXXVIII 
(1931), 406-27. 

tL. L. Thuratone, Theory of MvUvpU Faeiars (Ann Arbor, Mich.: Edwards Bros., 
1032), p. 20. 

tlbid,, pp. 17-19, 22 t27. 
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r£ssm refamce (txin wrw m hi fh. , 

fiictnr londinga or kst 4'hi- n-v.lnfiMii uf thA, * 

the roferGiiPc frame was i'alli><I ikr pTmrijKthnrrs Mihiiion.* 
tant c.uni)titatim)al udvaiUag.., in that it -uiv Billlf f”'’ 

matrix. Tlii.s ,m>lutirm w.us Avril,fi.ii M«r«. flie 

clovolopcd TIk; i)rim‘ii»!il-axm s.«iitfii.ii ha- n. iim.I,., ..m,. P^i’iplewas 

but imLoIuiL i,',vi£ir 

HIOM. It will iH, MUlllHl, liM, II, „! ,1„. „iv,.„ 'i^, 'f *?“■ 

aotomd mt,, tl,« turUir uiatru F. will,,-I,a „„ „„,| bTlhfitf^ 
frame of h\ tn arbitrarv a.s rit«(eriiiiiir,l l.v M,.* r,. • , reference 

P.ncd to n«ccl. It nmy ^ 

montally dctominml TOulli. i..|,l., r.-|,r..<,.i |. i„ «,. w,!,T 
t =«, .ra ted,, w, tl„.t ,1,„ ,.,1, f»u,,r tei; ,d;i“ 

otonUr „x„. The |,r„l,l,.,„ „„„. i. ,„ w,la„. ,|„. .,r ' 1 

eiicc frame into fhattjf Hi,!nnu<.|,nl -ives I 'Hd r il' *' I’''‘'“’K‘’"“^^cfeN 

cassccl its obtaiu,,,! (iiir, fro •7»l'«‘-«'<....M.lutiotnvillbcdis. 

frame of I'\ The tea vm-Lr r ^ ‘‘i 
The PruioS "'bute. 

is ‘J *'««! f‘»I**r imufiiml a.xis A, then 


( 1 ) 


r>Ap ~ «hXi^ -f- 4. 


projeSiE°LlormlathV'r^^ faeraunethia 

test Ap of perfect reliability. ^ " regarded as a 

termi^rLd «TmdST^^^ u'lMi i« Id btd» 

(2, li-t. - ui,X!, + „i,x=„ + |. 

+ ?a>ifl/8XjpXa,. 

writer 1^ «»«'“>«» "'m ouKK^ted to the 

Univeraity of Chicago. l^ejiartiiient of Astronomy at the 
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Summing for the n testa j, 


i i i j 

+ 2XipXap SXipXap OyiOya + 2XajXaj ^ gjattya. 


For convenience, let 


^r^Ap s u . 


Then the partial derivatives with respect to the direction cosine Xip of 


= 2Xip^^ayi + 2Xap^^ayiOya + 2XBp^^oyiayj, 


and the other partials are written in the same manner. 

The desired values of X*,, are subject to the restriction that A, shall be 
uni t vectors. Hence we have the conditional equation 

(6) « = X?, + Xip + Xip - 1 - 0. 

By Lagrange’s method of undertermined multipliers we have the following 
normal equations: 

J- fl — = n 

SXip ^ aXxp ’ 

The (r+l) unknowns are here the t values, X«tp and These are to be de¬ 
termined by the r equations (7) and the conditional equation (6). 

The partial derivatives of v are 

{ - 2X 

ax^ - ’ 

I'R'i ■ = 2Xsp , 


= 2X,p. 
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Substituting (o) and (8) in (7), dividing nach I'tiuation l)y 2 and run 
ranging terms, we obtain ’ 

“7i + + Xs, V njiaji + X,;. V ^ q ^ 

(0) Vajs 4- + X3„ ^ Q^ 

>^ip^ajiaja 4- Xj,^n,a»bj + + fi'j = 0 . 

Tliis is a sot of r homogeneous linear etmalitjns in the unknowns X, X 
Xap. llie determinant of the coctficierits in etjuations (£)) must vanish in 
order that a non-trivial solutiem may exist.* Retting tin; dotenninant equal 
to zero, we have the charafitori.stic ccitiation 


( 10 ) 


A = 


(Sftji + 0 ) 2a,-,a,-9 2a,-,rt;3 

iVijiaya (2rtj2 •+• fi) 

i’«,9a,3 (i'«=a 4- 0) 


0 . 


It will bo seen that the coetlirieiits «,», of this dotermliiant run be written 
m the form 

ll'l “ , 

whore I'\ is a factor matrix. The charaeteristic etiiiation Ihmi lieromea 

^^2) IO’« + ^/I = 0 

or 

IP4-/3/I = 0. 

By expanding the determinant, this wination ran he written in the expanded 


(14) 


/S' 4- Cl/S'-"-* + 4. cr 0 , 


Namely' ''' 

+ C 5/3 4 - ca = 0 . 

• A trivial eolutian fur (9) is to set ail tl.c unknowns equal to zero. 
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The coefficients of (15) can be written by expanding the characteristic de¬ 
terminant of (10), or they can be computed from the principal minora of P, 
Each coefficient c* in (14) ia the sum of all the sj-rowed principal minors of 
P. All the r roots of (14) are real and negative, and they will be denoted 
Pu Pii • • • I 

Each of the roots /Jp can be substituted, in turn, in (9). Each of the r 
values of fip gives a set of direction cosines for a principal axis. When a 
i-oot fip is substituted in (9), the solution gives the direction cosines of A,, 
which are Xip, Xsp, Xgp. 

The principal axes Ap are orthogonal. Their direction cosines may be ar¬ 
ranged to form a matrix of the transformation A from the given orthogonal 
co-ordinates of Fo to those of the principal axes. This transformation may 
be represented by the equation 

(16) FoA = Fp, 

where Fp is a factor matrix for the principal axes. Each value —is the 
sum of the squares of the projections of the test vectors on a principal nvia 
Ap. These arc also the sums of the squares of the factor loadings in the col¬ 
umns of Fp. 

Numerical example of indirect solution 

In Table 1 we have a small correlation matrix 22 and a factor matrix Fa 
with an arbitrary reference frame. It is desired to find the factor matrix Fp 
for the principal axes. The first column of Fp will then be such that the sum 
of the squares of its loadings will be a maximum. We first find the matrix 
P = F'aFa, which is of order 2X2, since the rank of Fa is 2. The expanded form 
of the characteristic equation (14) can then be written, and, since r=2 in 
this example, the characteristic equation is the quadratic 

(17) -I- ci/S -I- c* = 0. 


The coefficient ci is the sum of the one-rowed principal minora of P. These 
are merely the diagonal terras of P, so that 

(18) Cl = 1.87 + 1.06 = 2.93 . 

The coefficient ca is the sum of the two-rowed principal minors of P. There 
ia only one such principal minor in this example, namely, the determinant 
|P| itself, and hence 


(19) 


C8= |P1 =0.2133. 
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The numerical form of the characteristic eqiiati«)n then is 


(20) + 2.0300 p -t- 0.2133 = 0 . 

The two roots of (20) are —2.855207 and —0.074704. Uolh root-s are real 
and negative. Writing equation (0) in numerical h»rin, we obtain 


( 21 ) 


(1.87 - 2.855207) -H 1.33 = 0 , 

1.33 X,, + (1.06 - 2.855297) Xs;, = 0 , 


Tabk 1 


Factor Matrix 

Yt Correlation Matrix 11 


Factor Matrix Pp 



I 

It 


1 

2 

.1 

•1 


Ai 

A| 

1 

.7 

,3 

1 

..IS 

.53 

.71 

.07 

1 

.741010 

-. 175832 

2 

.5 

.0 

2 

..53 

.01 

.70 

.71 

2 

.7.58025 

. 184480 

3 

.8 

.5 

3 

.71 

.70 

.K9 

.80 

3 

.040450 

-.074454 

4 

.7 

.0 

4 

.tir 

,71 

.80 

.85 

1 

.010030 

.005426 

“ .. ■ ' "* 

2.855207 

-.074703 


Matrix 1’=PiP(i Tranufiinniition Matrix A 



1 

O 



Ai 

1 

1.87 

1.33 

■■■11 

.803525 - 

-.505271 

2 

1.33 

1.00 


.505271 

.803525 


|/q =0,2133 


IAI--I-1 


from which we have 


( 22 ) 


Xu = .803526 
X,i = .505271 


Direction cosines of major 
principal axis A|, 


where the .subsciript y; == 1 in X»ip. The major principal axis lias the direction 
cosines Xu and Xsi. It can bo identilied in the latent roots bctiauso the nu¬ 
merical value of —p i.s the sum of the squares of the factor loadings of a 
column of Fp. The primiipal factor p, for which ^ajp is a maximum, is called 
the major principal axis. The principal axis for which the sum of the 
squares SoJ, is a minimum is called the mean principal axis. This axis is 
also of considerable interest in some factor problems. 

The direction cosines of the mean principal axis for the present numeiioal 
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example are computed in the same manner from equation (13), in which we 
substitute the second largest root /3j. We t.ViPn have 


(1.87 - 0.074704) Xu + 1.33 Xu = 0, 
. 1.33 Xu + (1.06 - 0.074704) X„ = 0, 


from which we have 


Direction cosines of mean 
principal axes A*, 

where the subscript p = 2 in X„,. 

Having found the direction cosines of the two principal axes of the test 
configuration, we write the transformation matrix, A, which is 

Ai , Ai 

I Xu Xu (+.803526) (-.595271) 

(25) A = 

II X 21 Xss (+.595271) (+.803525) 

This is an orthogonal matrix by which the test configuration can be de¬ 
scribed in terms of the principal axes instead of the arbitrary reference 
frame I, II, in Fg. We now have 

(26) EoA = , 

which is shown numerically in Table 1. It will be seen that A is an orthogonal 
matrix. Its determinant | A | = 1. The sum of the squares of the columns of A 
are normalized. The geometrical interpretation is that the principal axes 
vectors are unit reference vectors. The cross products of the columns of A 
are zero, which has the geometrical interpretation that the principal axes 
are orthogonal, their scalar products being zero. 

The geometrical interpretation of the present example is shown in Figure 
1 , in which the test configuration is first drawn for the arbitrary orthogonal 
axes I, II, of Eg. When the direction cosines of the major principal axis Ai 
have been found (Xu, Xgi), they can be represented on the diagram, where 
Ai is shown as a unit vector. The sum of the squares of the test vector pro¬ 
jections here is a maximum, as seems reasonable from the diagram, since the 
major principal axis passes through the central part of the test group. On 
the diagram one may verify by measurement that the test projections on 
the principal axes agree with the numerical values in Ej,. The second prin¬ 
cipal axis Ag is also shown in the diagram. 

The numerical values of Xig and Xgg in (24) con be reversed in sign, since 



Xu = -.596271 
Xgg = .803525 
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the homogeneous linear equation (28) deiincs only the ratio of to Xm. 
Their numerical values arc determined by the re.striction that Xii+Xlj^i, 
If the signs of X 12 and Mt in (24) were reversed, thtui the second column of 
the transformation matrix A would also be reversed in sign. In Figure 1 we 
would then have the second principal axi.s reversed in direction. The deter¬ 
minant of the transformation matrix would be, reversed in sign, so that 
IAI = — 1. When this determinant is equal to — 1, we have an odd number 
of I'CvorBals of direction of reference axes. When | A | = ■+■ 1, there is an even 
number of reversals of axe.s, or no revciual. If the reference frame I, II ja 
subjected to rigid rotation in Figure 1 so that I goi-s to Ai when II goes to 
As, then the determinant of the orthogonal transformation is -h 1. If there is 
an odd number of reversals, this determinant i.s ecpiul to — 1. Such is the 
cose if we reverse the second column in A so that the reference veetora be- 


JZ 



come Ai and —As. It can be seen in the figure that the frame I, II cannot 
move to Aj and — As by a rigid rotation within the dimen.sionality of r=2. 
For most factor problems the differentiation between the coses in which 
|Al = -fl and [Aj = —1 is of no practical con.sequence. It is of some in¬ 
terest to know the relation between the ambiguity of .signs in equations (23) 
and the geometrical interpretation of the problem. 

A direct solution for the principal axes 

In previous sections of this chapter we have ccmsidcired an indirect deter¬ 
mination of the principal axes, in that the correlation matrix was first fac¬ 
tored into a factor matrix 1<\ with an arbitrary reference frame which de¬ 
pended on the particular method of factoring that was used on the correla¬ 
tion matrix. That was the author’s solution when the principal axes were 
first described. The principal-axes solution can be written more directly in 
terms of the correlation matrix and without an intermediate factor matrix 
P’s. 

Consider the correlation matrix and the desired factor matrix Ff of 


CorrelaUon Mcdrix Hjk 
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Table S, In this table the correlatien matrix hits only four rows anH f 
columns, and the factor matrix has two faf-t<jr eohimns. It is desired tnT 
cate the first principal axis so as to maximize the sum (»f the .stiuarea nf a' 
test vector projections on that axis. This means that tin- sum of the IZoT 
of the factor loadings fl,-i in the first column r.f must be inaximiL 

that the first-factor residuals must be minimiznil. Tlie lirst-faetor residim^ 
can be written ““uuais 

J'j* - «>!«*« = pjl. , 

where pji, is the residual. Sqtiaring the residuals, we have 

~ 2a/iO*ir,t 4- ~ p»* ; 

and, summing for all correlation coefficients, we hav(* 

m S S ’■?* - 2 2 2 +22 '«■ “22*- 


For convenience, let 
(30) 


2 2* -- 


Then 

(31) 


dOjt 


Setting the partial derivatives equal to zero, we obtain 

= ttyiSo?., . 

djapter the notation ff will refer to the latent roots with 

hiK f32) in^afd 20*1=^, which is the largest latent root. Writ¬ 

ing m matrix form, we obtain 


(33) 


lia = aff, 
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Hotelling’s iterative method of factoring 

This method of factoring enables us to obtain the desired factor matrix F 
for the principal axes directly from the correlation matrix without the inter¬ 
mediate arbitrary factor matrix Fo. Hotelling’s iterative method of factor¬ 
ing starts with a trial column vector Ui, so that (33) becomes 

(34) Rui = 

where the product Vi is also a colunm vector. The next trial vector, U 2 , is 
taken proportional to «i, so that Ut=kvi. Then 

(36) Rui “ 1^2 j 

which gives the new trial vector, Ut=kvi, for the next trial. The stretching 
factor k is arbitrary for each trial. This process continues until the product 
numbers a, arc proportional to the next preceding trial numbers Wg to any 
required degree of accuracy. The column vectors u, and v, are then both 
proportional to the de.sired column vector a. Let the proportionality be 
represented by 

(36) u = pa, 
so that Ru=v becomes 

(37) Ripa) = (pai9). 


The scalar product (?*«) then is 

(38) (itv) = (pa)(pa0) = p*/32o* = p®j3*. 


Hence 

(39) 


which reduces v to the desired column vector o/i. 

The latent root p can be determined at the solution by the simple rela¬ 
tion 


(40) 



When the first-factor residuals have been determined by equation (27), 
the residual correlation matrix pjk can be factored by the same process to 
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give the seeond column of h\, whose elements are a.-n. The sum of tlm- 
squares is - • i men 


(41) 




whicli is the second latent root. This is Hotelling’s iterative method of f..c- 
tonng the correlation matrix. It is an improvement on the writer’s oriEinal 
method of finding the principal-axes solution by the indireiit method of’fir^t 
finding an arbitrary factor matrix Fo and then rotating the reference frame 
to the principal axes. The principal-axes solution can be written to renre 
sent the whole factor matrix F, instead of one column at a time, as was done 
here. Then the interpretation of the charaf;toristic equation and the latent 
roots are the same as in the writer’s original paper on the principal axes 
Hotelling him renamed the priiicipal-a.xcs solution the vrincipal coinponenU 
Sometimes this term refers to the factor loadings a,, in I'\ and sometimes 
to Hotelling a iterative method of factoring. This method and the writer’s 
original indirect method give numerically identical results, as will be seen 
in the accompanying example. In computational work the imiiroid solution 
lequires less labor with the computing niethod.s now available, but tlie di- 
rect flolution is thcoristiciilly fclie more intorestin^j;, 

Hotelhng restricts himself to the ca.se of unit diagonal.s in the correlation 
matrix, but Ins method is applicable when other values, suidi m reliabilities 
or communahties, are written into the diagonals. It should be carefully noted 
that the rank of the correlation matrix, the number of common factors, and 
the latent roots are markedly affected by the diagonal valuc.H. The rank of li 
is lowest when communalitics are used in the diagonal cells. When unit 

diagonals are written, the rank generally becomes equal to the order of the 
correlation matrix. 

• characteristic of Hotelling’s iterative method of factoring 

IS that the convergence is slow when the larger latent roots are nearly the 
same. The convergence is rapid when the latent roots differ markedly in 
numerical values. In the numerical example of this chapter we have chosen 
a case m which the latent roots are numerically quite different, so that the 
conveigoncG is rapid and the solution Is reached in a few trials. The reader 

whic (!onvergcm.o in many praistiiial problems in 

whu.h the loots may have nearly equal numerical values. 

Numerical example of Hotelling’s iterative method 

ronte rf correlation matrix of order 4 X4, wliose latent 

roots are widely separated so os to give a rapidly convergent example of 
the terative process. The first trial vector, w., is taken proportional to 
he column sums of R, so that the largest numerical value of ui is unity, 
e matrix multiplication, Rui=vt, is shown in the next column. The 
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reciprocal of the largest entry in column vi is recorded as the arbitraiy 
stretching factor k, and we then have Ui = kvi in the next column. The ma¬ 
trix multiplication, Ru 2 =V 3 , is recorded in the next column. The proc¬ 
ess terminates when the two successive values U 2 and m, are found to be iden¬ 
tical within the reeinired degree of accuracy. 

The reduction of V 2 to the desired column vector is shown under the 
table. The scalar product (ujva) is computed and recorded as shown. The 
square root of this number is p/3, a.s shown. Finally, the reciprocal l/pfi is 
computed and recorded. The final column o,i is computed from Oj by the 
relation aii = v/pP. 

The fii-st-faetor residuals are then computed and are shown in the lower 
section of Table 2. The same process of factoring is applied to this table, 
with the resulting column vector 0,2 as shown. Finally, the two column 
vectors Ojp arc recorded in the desired factor matrix Fp. The first trial vector 
for a residual correlation matrix can be taken proportional to the absolute 
sura of the residuals in each column, including or excluding the diagonals. 
One can also ju.stify taking os trial values the square roots of the diagonal 
residuals. 

The factor matrix for the principal axes has two properties of interest. 
The sum of the squares of each column of the factor matrix F, is a latent 
root. Further, the (U'oss product of each pair of columns is zero. We then 
have for the sum of the squares of ea<!h column 

(42) X®'' = ' 

/ 

and for the cro.s.s product of any pair of columns, p and g, 

(43) ^o/j>«y« = 0. 

Both these propertie.s can be easily verified numerically in the factor ma¬ 
trix Fp. 

The present example docs not show the problem that arises when the con¬ 
vergence is slow. The wide separation of the latent roots in this example 
produces the rapid convergence shown here. When the latent roots are 
nearly alike, the slow convergence makes it desirable to introduce other de¬ 
vices to iticreose the convergence to the desired solution. 

The squaring process 

When the iterative method of factoring for the principal-axes solution is 
used on a correlation matrix in which the largest latent roots are of nemly 
the same numerical values, the process converges slowly. The labor required 
to reach the solution is then so considerable as to be discouraging. The con- 
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vergencc can be incrcuaed by tlic squaring prornss dfscribed by IlntGlIi., 
an improvement on tlie first form of liis iterative farkiring met,hod * 
Consider the first iteration Ru, = d (equation [341), with a column v t 
«i which IS either arbitrarily chosen as a start or cIkwcii by inspection 
mrfdatmn matrix U. If, now. this product is used as the next trial vector' 

Rvi == Vi . 

Substituting (34) in (44), we get 

n(Ru,) = i., 

or 

R^ui => Vi . 

Using va as the next trial vector, we get 

and then 

(48) 

By (47) this becomes 

(49) 

and, by (46), 

(50) 

This process can be continued, so that 

R-u = V. , 

where a: denotes any power of R. If R raiscl to a Hulliciently high power 
! 7 '"*7 P*'<>P'»'tlonal to the desired solution even if the’ 

choico'^of thlTtiSvei r ^ '•««‘!i'vation may be made about the 

ctZn of ? in iT h J proportional to any 

This situation fri? f seoondaiy roots, the oiiuation (fll) is satisfied. 

practicallv alwnvs i* i ^ in practice, so that the iterations will 

y always lead to the major principal axis. A simple example of this 

I of Principal Components,” pjyo^eirito. 


Rvi 


Vi. 


R(Rva) = , 


R*ui = V4. 
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effect in which iteration does not lead to the major principal axis is the fol¬ 
lowing 2X2 correlation matrix: 


1.00 

- .80 ■ 

+ 

1_ 

~ .80 

75 

1.00 . 

L+iJ 


R U 


Iteration with the trial vector -f-1), as shown, leads to the mean prin¬ 
cipal axis, whereas iteration with the trial vector (-f 1, -1) leads to the 
major principal axis. Examples of this kind arise very rarely with experi¬ 
mental data, because it is very unlikely that a trial vector will be propor¬ 
tional to one of the secondary columns in Fp, 

From (46) it is evident that one iteration on E® gives the same result as 
two iterations on R. From (50) we see that one iteration on R* gives the 
same result as four iterations on R, and so on for any power of R. The more 
rapid convergence of this process is offset to some extent by the labor of 
multiplying the correlation matrix by itself several times, and it must also 
be considered in relation to the fact that a large number of decimals are car¬ 
ded in this process in order to retain its full effectiveness. 

The relation of this process to the characteristic root p can be seen if we 
write Ra = ap (equation [33]), where a is the desired column vector and p is 
the largest latent root of E or of a residual matrix. This can be written 


(52) 

^Ra = a, 

from which we have 


(53) i 

sQiJa) = a, 

SO that 


(54) 

^5*0 = o. 

Repeating this process gives 


(55) 

R^a = j3*o, 


from which it is seen that if R is raised to the power x, the iteration with a 
gives the product numbers p^a. 

An interesting property of the correlation matrix is that when it is raised 
to a sufficiently high power it approaches unit rank to any required degree 
of approximation. * The factor matrix corresponding to such an augmented 

♦ Cyril Burt, "The Unit Hierarchy and Its Properties," Psychmelnka, III (1938), 
161-68. 
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correlation matrix haa only one column. This symmetric matrix whl . 
[s of unit rank can ^ factored by a single-!,olumn factor matrix whiJ 
be represented by the column vector = so that * ««chmay 

(56) ie* = AA' ; 

and It IS of some interest to see the relation lietwcen the single-cohnnn fant^, 
matrix A of R- and the first-column o of the factor matrfx F,, Let ^ 

(57) 0 = p,l, 
and substitute in (55), which becomes 

( 58 ) R^ipA) = : 

and this can be written 

but R^ can be factored by analogy with (55), 

li^A « ifc,l, 

where k is tlio largest characteristic root of R*, namely, 

ib = A'A . 

From (69) and (60) we get 

(®^^ pkA = pp*A , 

and hence 


(63) 


A = /3*. 


We cun then re-write (60) in the form 


(64) 

From (60) wo find 


li\A == (i-A . 


(65) 

and by (57), 

( 66 ) 


AA'A = fi*A , 





and, since 0= a'a, 

(67) 
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so that 

(68) /3 2 = i. 

P 

Hence by (67), 

1—g 1—a 

(69) ffl = /S2^ = fc2*A, 


so that the desired column vector %i of R can be obtained from the single- 
factor loadings of E*. This is not the usual procedure in the squaring proc¬ 
ess. The generally recommended procedure is to continue the squaring until 
the column sums of two successive squarings, E® to E*®, are proportional to 
any required degree of approximation. The column sums of B®, or numbers 
proportional to them, are then used as a trial vector u on the original corre¬ 
lation matrix E, so that Ru=v. The column vectors u and v may then he 
expected to be proportional, so that « or t» is proportional to the desired 
column vector aji. If proportionality is not attained, the iteration may he 
continued on E. The actual reduction from v to a is done by noting that the 
ratio 


(70) 



and if one of the trial numbers w/ is unity, then jS can be read directly from 
the corresponding value of Vj. If one of the trial numbers Uf is not unity, the 
root P can be determined from the ratio ^=S |»| /S |«1 for the last iteration. 
A useful device, especially when it is desired to reduce t; to a unit vector in 
the configuration before reaching the final principal-axes solution, is to com¬ 
pute the desired loadings from the relation 


(71) 


djl = CBj = 


Vj 

Vnuv' 


where 

(72) 


c = 


1 



When the correlation matrix has been raised to some power x, so that the 
column sums of E® are proportional to the column sums of the next previous 
matrix E®/* to the required degree of approximation, then E®is of umt rank 
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the same iipproximation. The single-faetor Joaclings a. of 

by the centroid method, wliich gives the unique values 


(73) 

in which 


o-i 



I 


fan be found 


ij=sura of absolute values of coll entries in row j of R *, 
mj= ± 1, according to the sign of sj, 

«/=algebraic column sums of R*. 

The desired factor loadings can be obtained from the column sums s 
of R without an additional iteration on R. If the column sums S' nf ^ 
the single-factor loadings a, of R^, are used in thritm'^ 

1 IS expected that u and u will be proiMirtional and that these will also S 
proportional to Oy,. Therefore, we write 

r^et Si denote (lolumn sums of R. Then 

::siM = T , 

where T is the column sum of the product numbers Ru= V. The ratio of 
Hence b“on^ fhameteristie root/3. 

(76) X - « 

i’w “ ^ • 

From (75) we have 

(77) 

From (74) we have 

(78) 
so that 

(79) 

and lienee 

(80) 


^SjU 


= 0 . 


= |3 = Zi'-’S?!®, 


SSiM 






2u2u»' 
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By (74) we then have 


(81) o = w, 

^ ^ VswSti*’ 

where u is proportional to the column sums of and Si represents the corre¬ 
sponding column sums of R. It is good computational practice to verify the 
determination of oyi by the iteration Ra =for any method of obtaining the 
values of a. An alternative procedure is to carry out the iteration Ru=v 
and then reduce v to aji by equation (71). Several relations have been de¬ 
scribed here, but it is not necessary in practice to verify all of tTiRm on each 
numerical problem in finding the solution Oyi. The same procedures are used 
on the correlation matrix residuals for determining each colmnn of the factor 
matrix Fp. 

Numerical example of the squaring process 

In order to illustrate the squaring process, we shall use a small eTamplB 
which does not converge so rapidly as the previous example with Hotelling’s 
original iterative method of factoring. This example is shown in the factor 
matrix Fp of Table 3. The two characteristic roots are 1.26 and .33 as shown. 
The two columns represent principal axes, as can be seen from the fact that 
SayiO,s=0. The corresponding correlation matrix R is shown in the same 
table. 

The expected column sums Sj of R^ are computed from R, and, since these 
are not proportional to the column smns of R, the complete matrix R^ is 
computed. Under each matrix we have reduced the column sums sj to the 
proportional values ksj, in which the largest value is unity. This facilitates 
comparison of successive sets of column sums. 

The expected column sums of R* are computed from B®, and these are 
again not proportional to those of fl®, so that R* is computed in full as shown. 
Next we compute column sums of 22* and compare with column sums of 22*. 
These two seta approach proportionality, but they still differ in the second 
decimal. Hence 22® is computed as shown. The column sums of 22^® agree 
closely with those of 22®, and hence it is not necessary to compute 22“ in 
full. The discrepancies here do not exceed .0002. 

In Table 4 we have a summary of numerical examples. The trial values 
u=ksj from 22“ are used in the iteration 22u=a, as shown. The computation 
Sw«=3.2400000 leads to the values of oyi by equation (71). 

In the same table we have the computation of oyi from column sums of 
22^®. In the first column of this table we list u=k8vi of 22*®. The values of oyi 
are then obtained from equation (81). For check purposes these values 
should be verified by the iteration 22o=jSn for one or more rows of 22. 
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Factor Matrix Ki 


I 

tl 

I .7 

.0 

2 - .6 

3 .5 

-.4 

“,4 

4 - .4 

.1 

—.. — ---- 


r ®. .2 

— .7 

1.20 

.33 


f’nrrrliiiinn ^fal^ix II 


Matrix K» 



1 

2 

1 

. 6174 

-.,5202 

2 

-.,5292 

.(MMM 

*i 

.1410 

“.32.52 

4 

“.3528 

.2.892 

ksf 

.1761 

.8077 

~.(I.5.HH 

“.26'J2 


.4-110 
- :i2r,2 

" . 2 tira 

.:^iNi 

l.CHHK) 


Matrix H4 


• 0H018-121 

- -Sdoiflroa 

.70018HK) 

- .56010528 

.28005204 

J-00000000 


.H<1U157W2 
.7258K52H 
.5‘j.i:i028.S 
.47805270 

.22008270 

■8212I2G1 


.50480288 

.50584802 

.40151208 

.2100tH)0() 

. 75021.500 


■- .5rKM0528 
.478(15276 

- .40151268 
.32041958 

- .162^507 

- .68041113 


Matrix It* 


2.47052806 
-2.11750500 
1.76406333 
41173006 

.70586,534 

i.noo(K)ono 

7.70451864 


-2.117r,0599 

1.81,515047 

-1.012.50038 

21003780 

- .60400810 

- .H.5607.SHO 
0.05528.16.1 


1.7(3466333 
-1.512,50038 
1.260.54100 
-1.00830600 

. 501308,85 
,. 7144547(1 
5..546]()170 


-1.41173006 

1.21003780 

-1.00839600 

.80070750 

- .403.38mT 

- .,57147083 
4..13(i87205 


4,48421281 

1.00000000 


Matrix It'* 

-^■857?i9l!r 3.20300917 

.8j71428.5 .71428572 


-2.562‘10732 
- .07142857 
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The principal-axes residuals 

When one factor column of Pp haa been determined, the extraction of the 
next factor from the correlation matrix is usually done by computing the 
residual correlation matrix, 


(82) 


Ri = R — aa', 


where /2i denotes here the first-factor residual matrix from R. These resid¬ 
uals can be computed in the same manner as for any other factoring method. 
The residual correlation matrix is then used for determining the next factor 


Table 4- 

Computation of aji hy Iteration Ru = V 



ti 


aji 

1 

l.OOOOOQOO 

1.26000000 

.70000000 

2 

- .86714286 

-1.08000000 

-.60000000 

3 

.71428672 

.00000000 

.50000000 

4 

- .67142867 

- .72000000 

-.40000000 


211(1=3.24000000 
l/2i(»= .30864108 
l/vS= ,55556666 


Computation of aji from Column 
Sums u = ksit of R” 



U 

ap 


1 

1.00000000 

.70000000 

Su = .28671430 

2 

- .85714286 

-.60000000 

2u' =2.67142867 

3 

.71428672 

.50000000 

Z8iu= .36000000 

4 

- .67142857 

-.40000000 

p’ = .48000908 
p = .70000000 


column aji of Fp. The procedures on Ri are the same as those which have 
been described for the first factor. 

In addition to the customary method of computing residuals, we shall de¬ 
scribe two methods, namely, (1) ^Hotelling’s adaptation of the squaring 
process to the computation of residuals and (2) Tucker’s method of comput¬ 
ing the subsequent principal-factor loadings without computing residuals. 

If the squaring process has been used in the determination of the first- 
factor loadings aj\ of Fp, then the augmented correlation matrix J2® can be 
used also for writing the residual correlation matrix raised to the same power 
with considerable reduction in computational labor. For this purpose we 
shall first prove several useful relations. 

Let 


(83) 


Q s oo', 



494 


MUI/riPLK-FACTOIl ANALYSIS 

wliero Q is ii square syinnietrle matrix of unit rmik i)r(»duc-e(l by the col., 
vector a, wliieh bus been determined. Tlie re.^itlual matrix /i, Ls then " 

(S'i) Hi -■ an' . 

We also have the two relations inevu.iisly eslublisbed, namely, 

L'a -- , 

and 

(^■* 5 ) (i n'n . 

From (33) and (83) we liav<‘ 

(SO) HQ Han'= ■ Haa', 

(S7) HQ ■■■■■ HQ . 

From (83) atid (So) wo can write 

■- «(«'«)«' 

= uHii' 

-• 0na' 

m 

Applying tlic.so relation.s to the uuKinentecl correlation matrix K* we 
have, startinR with /i’ and irsing (87), 

HHi = KHHQ) = u.-. ffRtQ 

m.HQ) - mm ■■■■■ ma 

- 

(89) UHi = pHi, 


and, in general, 
(90) 


R^Q = . 
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Another relation involving E* can be shown from (87) and (88) by writ¬ 
ing 


R^Q = R*(RQ) = 

= R{RQ)Q = RQ^ 

(91) R^Q=RQ\ 
or, in general, 

(92) = RQ- . 

Powers of Q can be reduced from (88) by writing 

Q3 = QQS = Q(^Q) = ^ 

(93) <2» = /3(/JQ) = , 

or, in general, 

(94) Q* = ^*-10. 

The residuals can be expressed by (84), (87), and (88) from the squaring 
process by writing 


= (E - QY = E® - 2RQ -h Q* 

= E* - 2/3Q + /SQ, 

(96) Rl = R^-0Q, 

or, in general, 

(96) RJ = E- - /3-‘Q , 

by which the residuals Rf raised to the power x can he obtained from the al¬ 
ready computed matrix J?®. In using (96) the procedure is as follows; 

1) The colunm sums s of 22® are used as trial numbers in the iteration 
Ra=v. Several iterations are taken, if necessary, until Oji are de¬ 
termined. 

2) Determine characteristic root /3. 

3) Compute the product numbers E®a=|9®c[, in which 



Correlttlion M(Urix Rj 


f''ncU/r AfcUrixp. 


1 rii 

2 Tji 

3 r,i 

4 r,, 


^ auV/Jii ojiV^i fijiV//, t flflV/jj 


*■14 

rji njiV^yj i 

fu 

'■«_ fliiv'j'iii 

V/j,t -ti 


_' _^ni 

* j “II “ll Oi, 

“ Hsi Oh a„ 

" j “»i Om Oil 

‘1 j ^1 Oa On 

I WHii 0 0 
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4) Determine /3*~* by the division 



5) Compute E* by equation (96). 

The squarinR process has advantages in rapid convergence, but it is also 
quite laborious in practice, especially when large correlation matrices are 
to be raised to a high power. 

Another solution for the principal-axes problem without residuals has re 
cently been proposed by Ledyard Tucker.* It is ingenious and looks prom¬ 
ising, but It has not yet been tried extensively. In Table S we have a 4X4 
correlation matrix Ei, which gives the first principal-factor loadings in the 
adjacent column a^i. The sum of the squares of this column is i9i= 81 
When this first factor has been determined, the usual procedure is to write 
another matrix of correlation residuals. The present method avoids the 
necessity of computing residuals. Instead, the original correlation matrix is 
merely bordered, as shown in literal notation at the top of Table B. The in¬ 
dicated elements of the bordering column and row have the effect of reduc¬ 
ing the largest (ilmracteristic root to zero. Then the major principal factor 
of the bordered matrix E-, is the second principal factor of the origmal ma¬ 
trix El. The <!orro.sp()nding factor matrix E, is also shown in literal form at 
the top of Table d with an added row. The sum of the squares of the first 
column of this factor matrix i.s identically zero, so that the major principal 
factor now b<!(!ome.s the second column of Fp. 

The bordered matrix Ea is shown in numerical form in the same table. 
Hotelling’s iterative pvoc.osij on this correlation matrix gives the second- 
factor column Uji, os shown, with the second characteristic root ^ 2 =.49. 
The matrix Ha is eon.struc!ted by bordering Ei with two additional rows and 
columns. Hotelling's proce-ss on this matrix Ra gives the third-factor column 
aja. The three factor columns are assembled in the numerical factor matrix 
FptA the bottom of the table. 

Graphical aids in factoring the correlation matrix 

In the iterative process of determining the principal axes the computa¬ 
tions can be reduced by graphical methods, at least in the first few trials.! 
The it(!rative process depends on the relation 

(97) Eu = vSm® , 

"The Determination of SuceesBive Principal Components -without Computation of 
Tables of llesidual Correlation OoofliclentB," Psyehojnelrika, DC (September, 1044), 
149-53. 

t L. L. Thurstone, "Graphical Method of Faotoring the Correlation Matrix," Pro¬ 
ceedings of the National Academy of Sciences, XXX, No. 6 (June, 1044), 120-34. 
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where R is the given correlation matrix, u is the trial column vector, and v 
is here a column vector proportional to the product Ru. Consider in particu¬ 
lar the scalar product of row j of J2,-* and the trial column vector u. This 
scalar product is 

(98) RjU = vjSu ^, 

from which we have 


(99) 



but this is also the well-known equation for the slope of the regression line 
r on u through the origin for a plot of r against u. If we plot columns of Tjk 
against the trial values Uk, we get a plot with n points. The best-fitting 
straight line through the origin (regression r on u) can be drawn by inspec¬ 
tion, and the slope of the line is easily read graphically with sufficient ac¬ 
curacy for the first few iterations. That slope is the value Vj. To plot, say, 
thirty points and to draw by inspection the best-fitting straight line through 
the origin takes less time than to obtain the cumulative sum of thirty cross 
products on a calculating machine. 

By equation (97) it is evident that at the solution the values «)y= w;=o/i. 
When a sot of values of 0 has been determined graphically, we plot v against 
« and find the slope m. In the first few graphical iterations, this slope will 
not be unity because the trial values u are probably too large or too small. 
If the true values are better represented by ku, in which fc is a stretching 
factor, then a plot of r against ku will give a slope of v/k instead of v. When 
these graphs have been drawn, the slope of v/k against ku should be unity. 
But the obtained slope of v against u is m for the values actually used. 
Hence the observed slope 7n=fc*. Having found the slope m of the plot of 
V against u, we find k = Vm. Then if we should take a new set of trial num¬ 
bers Xi=kUj, the iteration would give, instead of equation (99), 

(100) g = 

whore y = v/k. The slope of y against x should now be unity, and the values 
of y should be used as the trial vector for the next graphical iteration. The 
determination of m and k can be done with a slide rule, and the new trial 
values y=a/fc can bo similarly determined. The slope m can be found either 
by inspection or by simple summing with the method of averages, in which 
m=for like signed pairs of v and u. 

A numerical example is shown in Table 6, which starts with the correla¬ 
tion matrix R of order 10 X10 and rank 3. The corresponding factor matrix 
Fp for the principal axes is shown in the same table. It is the solution to be 
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found from R. The latent roots of R arc 2.85,1.47, and 0.03. These are the 
suras of the squares of the columns of Fp. In the same table the initial trial 
vector u for the major principal factor is taken roughly proportional to the 
sums of the columns of R. Column 1 of R is plotted against column Mi, and 
the slope is estimated to bo approximately +.05 and is recorded in column 
Vi, Ton such plots give the values in column wi. The .slope Ls read directly 
from each graph by noting the ordinate of a straight-line fit nt uj = 1, Next 
obtain_tho two column sums, JIwi and Sci. The ratio ^v/^u=m, and 
k= Vm. This summation can be absolute sum-s for like signed pairs of u 
and V. Then compute y\—V\/k with a slide r»ilc. The.so aro also the trial 
values Us for the next trial. Proceed likewise for three trials, which give the 
desired values of to two decimals. 

The first-factor residuals are then computed. Tlu'se are 
Choose as a starting vector tliat column of the lirst-factctr residuals which 
has the largest absolute sum, ignoring diiigonals. This i.s column 1. Its val¬ 
ues are recorded in column ui for factor II. The procedure i.s now the same 
as before. The third iteration wa.s taken on a ^■aU■ulating machine, and it 
gave the second-factor loadings the second column of F„ hj two deci¬ 
mals. The hist iterations for each fa<!tor can he done on a calculating ma¬ 
chine to obtain greater accuracy, while the first few iterations can be done 
graphically to save time and labor. The computation for tl>e third column 
of Fp was done in the same manina. 

Occasionally, when two or tlireo latent roots aro nearly the same, the iter¬ 
ative process will be found to o.scillate, or the convergence will he slow. This 
is an indication that the test configuration has nearly equal thicknesses in 
thaso dimensions, so that the configuration is nearly cirmilar or spherical in 
these dimensions. If the purpose is to extract the maximum variance from 
the eorrclation matrix, it does not matter whenj we place a set of orthogonal 
axes in those dlmcasiuns which are represented I>y nearly equal latent roots. 
In. such a situation it is desirable to reduce the obtained vector v to a unit 
vector in the system without waiting for complete convergence. That can 
be done with a stretching factor c on o so that «i = a, where, a are the desired 
factor loadings. The value of c can be foimd from equation (72). By this 
device the computer need not be unduly delayed by slow ismvergence in 
obtaining a factorially useful solution. The graphical method here described 
can be applied to a variety of computational problems. 

Additional theorems 

We shall consider hero some additi<»nal propertias of tlio principal-axes 
solution which are of theoretical and computational interest.* Starting 
with the relation of equathm (32), we write 

(101) RikO/l = OjlPl 

* The theorems in this section were assembled by Ledyard Tucker. 



THE PRINCIPAL AXES 501 

for the first column o>i of the factor matrix Fp for the principal axes. For 
the second column we have, similarly, 

( 102 ) RikPtji “ , 

and, in general, 

(103) • 

The elements of Fp are a,-,,, and the characteristic roots fip may be taken as 
diagonal elements in the diagonal matrix D. Then, in matrix form, 

(104) RFp = FpB. 

The matrix Fp is orthogonal by columns, so that ^ =0, where p and q 

i 

represent any pair of columns. Since djp =Pp, the columns of Fp can be 

i 

normalized by the poatmultiplication FpD-^. The matrix FpD~i is then an 
orthogonal matrix, which may be denoted A, 

(105) FpD-i s A or F, = AD*, 

by which wc see that the columns of A are proportional to the columns of the 
factor matrix Fp. From (104) and (lOB) we have 

(106) RFpD-i = FpDD-i , 
and hence 

(107) RA== AD. 

Premultiplying (107) by A', we have 

(108) A'EA = A'AD ; 
but, since A is an orthogonal matrix, we get 

(109) A'22A = D 
or 

(110) R = ADA'. 

Since AA' == I, we get from (105) 

(111) F'pFp = D. 

Several useful relations of the characteristic roots Pp are as follows: The 
sum of the squares of each row; in any factor matrix F is the oommunahtyhl. 
Hence the sum of the squares in the whole factor matrix F is equal to the 
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sum of thfi diagonal chmunits in R. TJn< .sum f,f tin, suuiiros in i 

of tiic root II(..n(T flic .sum ..f llm of all tl,n nlnr 

is equal to the sum of the roots and this .« uk/ L u 
clemouts of R, ^ diagonal 

The sum of the squares of (1... eorrelaf ions i„ R i„ 

squares of Iho entne.s m the inafri.x P P’R, where /■' is miv fnnt 
for R. We write matrix 


( 112 ) 

and then 
(IKl) 

which hefionies 


r’;i 


\’ 




X "' rt V v"^ i V t' '* 

J ^ a k *11 f 


(IM) 
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(ur.) 


N" V 


«i St ' j / ' ' 
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^ * »• .V \ I j 


llllt 

( 110 ) 

in whicih the elements an* 
(117) 


FP, 


VmM ■ ' Os^O,,, J 


and hence 
(118) 


VVr\ \'\" 

-W *w ~ - ■ -^ - l>m i ■ 


I'or the principal axes we have, hy (1(15), 

Kf'\ • (MmM)i) 

But A is an ortliogonul transformation, and hence 


I 
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Hence the diagonal elements of P are the characteristic roots of R. It can 
be shown that the characteristic roots of R and P are identical 

If, in applying Hotelling’s iterative method of factoring, the first trial 
vector is orthogonal to the first s principal axes, it can be shown that all suc¬ 
ceeding trial vectors will also remain orthogonal to the first a principal axes 
and they will approach the (fi-l-l)th principal axis. ’ 

It can also be shown that if we subtract a number It from each riingnnp i 
element of R, then the characteristic roots are reduced by the scalar k 

but the solution A of equation (110) remains unaltered. The introduction 
of the decrement k on the diagonal elements of R can be used for accelerat¬ 
ing the iterative process. The iterations can be made to approach the m e an 
principal axis instead of the major principal axis by this device. The mean 
principal axis can also be determined by iteration on P-\ which has the 
characteristic roots 1/Pp, and these are the diagonal elements of D-K 

Advantages and limitations of the principal-axes solution 

The principal-axes solution for the factor problem has an intrinsic inter¬ 
est because of its many mathematical properties, including the fact that it 
is a unique solution for any given correlation matrix. That was the writer's 
motivation in the original formulation of the principal-axes solution in 1932. 
Soon after publication of the solution, it was realized that the solution did 
not satisfy the psychological requirements for which the simple-structure 
solution was devised. Because of the rather general confusion about the con¬ 
troversial issues in this problem, we shall summarize briefly the advantages 
and the limitations of the principal-axes solution, including a description of 
the types of problem for which the principal-axes solution is applicable and 
of those to which the principal-axes solution is not applicable. 

A factorial analysis can be made for one of two purposes, namely, (1) to 
condense the test scores by expressing them in terms of a relatively small 
number of linearly independent factors or (2) to discover the underlying 
functional unities which operate to produce the test performances and to 
describe the individual differences eventually in terms of these distinguish¬ 
able functions. Many arguments about factorial methods could be resolved 
if the participants would indicate which purpose they have in mind, because, 
strictly speaking, there is no intrinsically correct factorial method except in 
terms of what the investigator is trying to do. According to the first purpose, 
factor analysis becomes essentially a statistical method of condensing the 
test scores. According to the second purpose, factor analysis becomes essen¬ 
tially a scientific method for sustaining or rejecting hypotheses about the 
nature of the underlying processes that produce the test scores. These two 
points of view are both legitimate in their respective places. There is trouble, 
however, when two investigators have these different points of view and 
proceed to argue about factorial method without recogmzing that they im- 



504 


m '1/i‘IPIJ>I'ArT( )H AN'ALYSI.'^ 

ply entirely (lifTnrcnt f)bj(!rtives with (hi-ir niinlvKc.s, It i.s the second !,• 
tivo that htus guided the writer, sin,-,. IfWl, iirdinvloping muitinle 
methods. It is the first ttbjecfive that, is ustiallv imr.lied by 

i„.» who writo on tetorial „r.,l.l,,„s. Thi, .'iirlln^o roEf*' 
13 largely rasiwiisiblc for eontrfiversies idH.ut faetorial method Manv 
undcrstanding.s in this field would prob.ably be resolved if we all reco^nW s 
that a factorial analysis should be judged in terms of f he i)urpo.se for whil 
It IS mtule and that niultiple-fiM-tor analy.sis is a flexible and iMwerful tl!! 
that can serve as a guide in a variety of si-ientifie luol )lein.s, ' 

iUt as consider, first, a tabhf of .scores n,, for individuals i in t,(>,sts j Thin 
18 the seoi-e matrix of onler a X-Y. For .‘onveiiienee let the .s.>ore.s be recorded 
m standard fimn, with unit .standard deviation and with origin at the mean 
1 Ills tabic shows n .scoras for each of the .Y individuals. If the tests arelTr 
related, wc may undertake a fac-for analy.-is ii. order to roiuleii.se a larJc 
•score matrix .so that each indivirlual may bi* de-seribed a.K to i he same domain 
in terms of a relatively small immlMT irl of linearly iiulepmulent factor 
scores lastcad of the. large inimber («) of test .seore.s w-i(h wl.iel, we stS 
the score matrix, ibis is e.ssenf lally astaf isf ieal problem, and, as such, there 
is no demand that the factor scores shall have any particular internrotntion 
m terms of the processiw that imHhu-e. I lie scores. This situation ia very 
similar to that of writing a rcgres.sion ctpinf ion in which we want a set of co^ 
(ifnoients for the iiideperidmil variable.s which will give that linear combL- 
tioii 0 them which iniminb.e,s the. residuak in estimating the dependent 
variable. Whoa wc .solve the lea.st-«iiuare,s [iroblem and write a regression 
equation, we demand only that the regriwjon eoellifients .shall be numbers 
which inminme the residuals. We usually make no demand tl 

i«t<Tpn*tisl in terms of the processes which pro- 
duced the dependent variable .scure.s. If that is ever done, wc can expect 

h ir*T''"' """I''™ ”■ Mlin*. in tl,»t it M- 

iootMl by ail or by many „t tlia pr<.,i*..a wbirl, ,im.,.t Ilia pmblcm. How- 
ever it i.s just as legitimate to lu^k for a condensation of tlie te.st score.? into a 

S mnwU T' f indeiieiident variable,s for the purpose 

an^rSn Praliftion of the depmulent variable, without 

in terms of tbu n the regre.ssittii i-oeflieients might mean 

in terins of the prjicasscs that, fuiidamenf ally determine them. 

starhng with the .st;orc« matrix of order uX.Y, it i.smir oliiect. lu-.cording to 

rXA^te wlihh"'^y* *" "''''t'’ f»"'tlier .score matrix of order 

sinaHor m t "“’ividiiul in terins of this 

which ia covorp^ ti ‘ cover easmitiidly the same domain 

Th^fundar-t 1 7 test battery. 

Ire rtTv 1 ," “'"t formulated in 1931 applies 

, amely, that the number of linearly independent factore in a correla- 
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tion matrix is the rank of the correlation matrix.* The corrpljitir.Ti tv, f • 
for this statistical problem has unit diaeonals because the correlati^r.’' 
trbr B = a/mSS’, where the elements of S ore standard mST 
The »ore dements in S ate fallible, in that they s» eopenmentolly d<^ 
t^ed and hence there .s at tat some part of the variance of each test 
which IS fortuitou.s and attributable to variable errors. The rank of the cor 
relation matrix with experimentally determined correlation coefficient is 
necessarily of rank equal to the order of the correlation matrix Hence 
strictly speaking, n=r with experimentally determined correlations If we 
carry out the factor analysis with this literal interpretation, then we shall 
have as many factors as there are tests. We might as well use the tests as 
they stand for the description of each individual, since we have gained noth 
ing m the economy of description. However, there is a gain in the statistical 
sense in that the new factors would be uncorrelated, whereas the tests are 
correlated. The investigator may consider it worth while to use a set of n 
uncorrelated factor scores for each individual instead of a set of n correlated 
teat scores. That may be his choice. 


Economy of description of each individual can be obtained in most prac¬ 
tical problems, so that r is leas than ?i, even with the present formulation 
because it may be possible to select a relatively small number of factor 
scores or indices which cover most of the variances of the tests in the bat¬ 
tery. This is, in fact, the objective when the principal-axes solution is used 
without rotation of axes. The investigator then makes a factor analysis in 
terms of a relatively small number of factors which account for the test 
scores with residuals that are so small that he is willing to ignore them. The 
number of factors to be used in such a description depends on the size of the 
residuals that arc judged to be negligible. 

In the writer’s first attempt to solve this problem, the first column of the 
factor matrix was so determined that it accounted for the maximum possible 
amount of the variance in one factor. Geometrically, this solution is found 
by placing the first axis in the test configuration so as to maximize the sums 
of squares of the test vector projections on the first axis. This is, in fact, the 
major principal axis. The next column was so determined that it accounted 
for the maximum possible amount of the variance from the first-factor resid¬ 
uals. The process can be continued until the residuals are negligible. It is 
evident that the principal-axes solution is exactly the desired solution for 
this problem. At first, it was necessary to factor the correlation matrix with 
an arbitrary orthogonal reference frame, which was rotated to the principal 
axes. Then, only the first few principal axes were used to describe the test 
battery, leaving the remaining variance unaccounted for in the form of resid¬ 
uals. With the publication of Hotelling’s iterative method of factoring, it 


* L. L. Thuratone, "Multiple Factor Analysis,” Psv(Aological Review, Vol. XXXVIII, 
No. 6 (September, 1931). 
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became posHible to (btermine the principai directly from the nn i 
ton mntn., „t a tima „„d 

Imtonng neod oinUnnc „iily u„lU iho r™iil,ials am jiutort i„ J 
Tlio solution IS in such a form that we eiiii say with confidcni'e time ^ 

»t of r Jinoarly indopomta a«., 1„, It,™ n d t L'S! 

« ™m. «,l,lah account- tor ntorc ,.t the vnrinne l talE ^ 

the to , pnncipal ,a„p,„ y,,, ,],,,.riptl,,„Tau"‘‘J^,'* 

rorthotelncorcn«,ltl,tl,iHn,n,d».r.,fla,.,op.. In prLdlcc , „,T‘I'T' 

ton or oaccadvn labor ,vitl. a ladp, ,..,rrcln.lo„ n dri" "irr tZ ±:'*' 
mise IS to determine a factor matrix witli m», „f | h,, centroid 1 W T' 
determine one or two more factors than would be rctiuired bvthe n 
axes m order to cover the same total variance. This emitSam^r? 
bc^tated to the principal a.xes when tliat is the desired .solution ^ 

We con.sider, ne.xt, the second ptirpo.se for which a fiuUoi.: ii i ■ 
be undertaken, namely, to discover theunderly t.K fun.-tiondiiS^” 
operate to produce the test performances. 1 volSl 
aa art objection tu the mere statement of this purpo.se, namely that no S 
od of analyzing data can di.scover factoni Let us meet .■.w.h t • v? ?' 

Ita annlytoal rnctUndn '.hat ..cSini ™ Cfrp« 

unldcnTdTiJ nl““ir,'’“‘‘ '"T”.. 

Tho nature, let us (anteider a set of te.sto of visual nercention 

is invol™d“Sn ‘"h V''" »«'“to 

functions On tho^hA?. J “ • ^ nf several or of many 

tions such as visual an ‘t exj)oriment.s, two visual func- 

lated amoL be postu- 

to some extent in its variancrbur^Uirfi!;!**^^^ 

larire and diHf-lnnf n^ri m figures to be seen are reasonably 

will be represented in onl* illuminated, the factor of visual acuity 

in studying individim negligible part of the total variance 

vLua^Sentli S ^bnilarly, the factor of 

of the tests mav have “* niost vi.siial tasks, but most 

by individual diffornnnoQ • * none of their variances accounted for 

individual diffprnnno ’ y™nl closure. If such factors operate to produce 
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considered with special reference to these two postulated factors, apart from 
the other factors that are undoubtedly present, then we shall have a fan¬ 
shaped configuration of test vectors in the plane of the two postulated 
factors. Toward one edge of the fan we should find those tests which have a 
large part of their variance attributable to one of the postulated factors, 
and toward the other edge of the fan we should find those tests which are rel¬ 
atively more saturated with the other postulated factor. This is, of course, 
the simple-structure principle in two dimensions. If it is found that the test 
vectors really do lie in such an arrangement in the test configuration and if 
their relative positions agree with the psychological interpretation of the na¬ 
ture of the tests, then we shall have experimental evidence that sustains the 
factorial interpretation; but here, as elsewhere in science, no hypothesis can 
ever be proved to be correct by any experiment. It can only be shown to be 
plausible. If, on the other hand, the test vectors do not oblige us by falling 
into the predicted fanlike structure but fall, instead, into some other entirely 
different arrangement, then we have evidence that our postulated factors do 
not agree with the functional unities that operate to produce the teat per¬ 
formances. We must then guess again as to the possible nature of the under¬ 
lying order. This is, in fact, the rule in factorial experiments. They usually 
teU us, in effect, that we must guess again. When a factorial hypothesis is 
sustained, it is a challenge to investigate further with the leads whose plausi¬ 
bility has been indicated factorially. An example of such a failure by the 
writer was a hypothesis that the general intellective factor was a maturar- 
tion factor. Factorial results at different age levels have recently shown 
that such a hypothesis is probably wrong. 

In setting up factorial experiments it is well to design the tests so that the 
factorial results may have an opportunity to give us crucial tests of a hy¬ 
pothesis or in the choice of rival hypotheses. One such pattern of great use¬ 
fulness is to design tests which clearly include the postulated factor and 
other tests in the same domain, as aiinilar as possible, which do not involve 
the postulated factor in the test variance. Presence or absence can then be 
predicted for the postulated factor in each test. Those tests which do not 
involve the factor should lie at one edge of the fan in two dimensions, in one 
plane in three dimensions, or in a hyperplane in n dimensions. Furthermore, 
all the tests which do involve the postulated factor in their variances should 
all lie on one side of the hyperplane and not on both sides of it. This is 
again the simple-structure principle in analyzing the test configuration. 

Scientific interest in a simple structure, when it is found, is relative to the 
state of knowledge at the time of the experiment. For example, if we should 
set up some, tests of visual perception and some tests of auditory perception, 
we should not be surprised to find that the visual tests had something in 
common which was entirely absent in the auditory tests. We might then 
call the factors merely visual and auditory, and that would be a first rough 
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guflss, whiiih would, no doubt, be relinetl with further experiments Th 
there should be distinguislnible funethmul unititw for these two modalit 
is probably taken for granted, ho that the rntigh factorial experiment wouS 
be of little interest. We should know surh a result before we .started 0 
the other hand, the clean separation tjetweeu the verbal factor V and th" 
word-fluency factor W was not at all evident when .several <^ru(■ial tests wr 
devi.snd U) tost the hypothc,si.s that at least two .soi-h fact<ir.s wore rcsnonsihl! 
for .some of the individual dilTereiici« in verbal tasks. Two synonyms teats 
were dcvi.sed, with the prediction that one would be high in V and zero in IF 
and that the other synonyni.s test would behave in ilui oppo.site manner 
factonally. I ho prediction wim .sustained, and this constituted a lend in the 
further investigation of verbal functions in human iiifelligence. 

Now suppose that the factorial analy.Hi.s was made by determinine the 
principal axe.s and that the sidufion was left in that form without roMon 
of ax(!H to simple structure. The tastscore-s would, indetsl, be accounted for 
by the smallest po.S8ible numlmr of faetoi-s, ami the nr-siduids would then be 
mminuzed by the well-known method of least H<iuare.s. In the two-dimen¬ 
sional example the major principal axis would be in I he middle of the fan of 
trat vectors, and the seismd prim-ipal axis would lie nrhitrurily at right an¬ 
gles to the first axis. Such a rcHoliition doe.s not give as tlie information we 
are looking for if our purimso is to investigate hyiKith(>.ses concerning the 
underlying processes that determine the individual UilTerences in porfoim- 
anoe. It should be evhlent that the principal-axes solution i.s the ideal solu¬ 
tion for the problem of stati.sti<-al comlenHatioti of the test seorra into the 
smallest possible number of factors but that thlsHolution is inadequate for 
the analysis of the underlying proceK8e.s ami their identific>ation. 

We have considered the principal-axe.s solution with referemru to two dif¬ 
ferent purposes for which a facdor aiialy.sis may bo undortaken. There are 
several situations in factor unaly.si.s in which the principal axes are of inter- 
Mt, apart from the major purpo.ses for which the analvsi.s is made. Even 
though we discard the principal a.xo.s us the fltud fiwtorial resolution to be 
studied for scientific interpretation, the principal axe.s are, nevertheless, of 
fundamental interest. Consider the problem of aiialyning a correlation ma¬ 
trix with exponmontally determined cocfficiinits. Because of the fact that 
every coefficient in the tabic i.s dotorminod in part by fortuitous variable 
errors, we must recognize that the total variance cannot be accounted for in 
terms of a limited number of factora wIioho intc«rj>retation may constitute 
G major purpose of the analysis. A part of the variance must necessarily 
be Msigncd to the variable errors. The fir.st task is to factor the correlation 
matrix in terms of a limited number of factom, and the second task is to ro- 
tate the arbitrary reference frame to that of a simple structure, if it can be 
fn,. factors. In determining the first-factor matrix be¬ 

fore starting the rotation of axes, it is desirable that the given number of 
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factors shall account for as much as possible of the variance of the correla¬ 
tion matrix. If we could disregard the practical problems of labor, time, and 
cost, wo should analyze the correlation matrix by determining the successive 
principal axes with communalities in the diagonals. These would be repre¬ 
sented by the successive columns of the factor matrix. When the residuals 
became small enough to ignore, the factoring would be discontinued, and the 
factor matrix would then be ready for the rotational problem. We should 
like to have the assurance, if we could get it with a reasonable amount of 
labor, that the r factors that have been determined account for as much of 
the total variance as is possible with r factors. That assurance would be rep¬ 
resented by the principal-axes solution for the first r principal factors. But 
it should be noted that such a principal-factor matrix is not the final solu¬ 
tion if the purpose of the analysis is to discover the nature of the underlying 
order. Such a principal-factor matrix is only the starting-point for the rota¬ 
tional problem. All students of factor analysis are therefore interested in 
the principal-factor solution, no matter what their point of view may be 
as regards the purposes of factor analysis. Fortunately, this computational 
problem can be dodged by using one of the less laborious factoring methods 
to obtain a factor matrix with aihitrary orthogonal axes, continuing the 
factoring one or two factors further than would be required by the principal 
axes. The rotational problem would then give essentially the same solution 
as would be obtained if the principal axes had been known. No matter what 
method of factoring is used, it is a safe rule to continue the factoring until 
one is sure that the factoring has gone far enough. Too many factors can do 
no harm, but too few factors are sure to cause trouble in identifying the 
structure. If too many factors are determined in the factor matrix before 
rotation of axes, then the residual factors appear in the rotation of axes, and 
they are left without interpretation. When the principal-axes solution be¬ 
comes available with leas computational labor, it wiU, no doubt, be preferred 
by all students of this subject, and they will start the rotational problem 
with the principal-factor matrix. 

Another situation in which the principal factors are of interest is found 
in the rotational problem. When the rotational problem begins, one can be 
reasonably sure that the test configuration is thin in one or more directions 
that represent residual factors which are to be ignored in the interpretation. 
It would be useful to be able to determine the mean principal axis of the 
test configuration at the start of the rotational problem. One of the residual 
factors would then be indicated. The next principal axis might also be negli¬ 
gible as to variance. In this way several residual factors might be deter¬ 
mined at the start of the rotational problem if the mean principal axes could 
be readily computed. The residual planes can be identified in the rotational 
procedure, but some of this labor might be avoided if the mean principal 
axes could be readily determined. 
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For till! Krst purposo in fiiftm-iul aiialy.sis I lio inuicipal-axis solution • 
indicatp-cl, and for tlio scnoiid puriioso tlin .siinple-sfriirtnin snlnlion is ind'^ 
dated. Other solutions may be added eventually for hot h of tlie.s,, problem'' 
especially if noii-liuenr factorial methods are developed; but the prose"t 
discussion is limited to the liiuau- factorial metbod-s that are now known 
The writer developed both of thp.se solulion.s, fir.sl, the principal-a.xos soln' 
tion, which was discarded for the siinple-struclurt! solution because of ngv 
chological considerations. Mo.st mathcnuilical .statistician.s who have con" 
tribiitcd to factorial theory have liniifed themselves .so far to the princinal" 
axes solution and its properties. Thi.s is natural becau.se the principal-Lq 
solution lends itself well to mathematical treatment. It is to be hoped that 
mathematicians will turn their attention also to the chullenginK problems of 
developing the .simple-structure concept and its implications. It has chal¬ 
lenging implicatioas for the development of .scientilic methods that are bv 
no means limited to p.sych(jlogy. ^ 



CHAPTEK XXI 

THE APPRAISAL OF INDIVIDUAL ABILITIES 

In previnus chapters the main problem has been to devise factorial meth¬ 
ods which would be sufficiently powerful to deal with the complexities of 
multiple factors so as to reveal functional unities, with a minimum of restric¬ 
tion as to their nature and the interrelations of the factors. To discover the 
factors and to sustain or refute postulated factors have been the principal 
purposes. The development of the factorial methods has been a continuous 
process of compromising between the theoretically complete and ideal solu¬ 
tions and those solutions that can be made available with a reasonable 
amount of labor, time, and cost. We turn, now, to the problem of apprais¬ 
ing individuals as to the factors that may have been identified, either as 
reasonably pure factors or at least as functional unities that are practically 
useful in dealing with individual differences. 

In dealing with this problem of appraising individuals as to their profiles 
of abilitie.s, wc shall develop, first, what seems now to be a rather complete 
statcmont of the solution for the factors that have been identified and which 
can be tested for; and then we shall consider the compromises that will be 
necessary in practical situations which will rarely allow a complete solution. 

The regression x on s 

Let us assume that a set of n teste is available for which the factorial com¬ 
positions are known and that the whole battery of tests is given to each sub¬ 
ject for the purpose of writing his profile of r factorial abilities. Here, as be¬ 
fore, let the standard score of individual % in the primary ability p be de¬ 
noted ipi. Similarly, let the standard score of individual i on test j be de¬ 
noted Sji. The problem then is to estimate the standard factorial scores Xpi 
in terms of the given and known tot scores sa. This is a conventional form 
of statistical problem which calls for the regression Xpi on syi. The ^ven 
test scores are the independent variables in terms of which the individual 
factorial scores are to be estimated. We then have the equation 

(1) Xfi = + epi j 

J 

where the subscript p refers to primary factors, j refers to tests, * refers to 
individuals, and w is the regression coefficient or weight of the score sn m 
test j in the estimation of the primary factor p. The residual or^crepancy 
between the true value of Xp,- and the best value that can be obtaine as a 
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linc'iU’ ('niiibiiialion of last Kforos is (lpiiiitt.il * rt i - . . •. 

true iiuliyidual faHor scorns aro the values 1;;.' *•>'> 

E«lUiition (1 j is a rogrcsshui eriuation, in which the test .scoi-,.« 
n .nhc,,endent variables and r,. is the dependent variable to be eiiirH ^ 
the best linear combination of the test scores. The problem of tin,r '^.5^ 
3cst linear combmution of the. test scores is that of tindinii the 

lin. 3ri,,™ ..... 


(^j 


.v - ir,s - li, 


'vliero .Y of order rX A' is the matri.K of factor score.s wit li elements r W.f 
"tand‘!rd test ^ '''' '‘XA^'is tlj 

fii <-.u \\ puiimry fuclor j) llutt in ff» |h* (•.stini'iti'il in tin. uhK; t i 

(5) 

which become.s 


A'A’' = (.V - ir.SKA' ~ irX)', 


Ot) UK' = A'A" - .V.S'Tr' - WKX' + H'.S'.SMl". 

Since these terms represent scalars, we can write 

A7-;' = A'X' - 2ir.sAY' + ir.s’.s-'H-. 
I'rom this we obtain tlio normal eiination hn- 11', 

A',S' ir,S,S'. 

Multiplyinp; both sides by 1/;Y, wo have 


(7) 




H. \V Turnbull and A. C. Aitken, Canonical Malricea 


1932 ), p, 173 . 


(London: Blackie & Sons, 
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( 8 ) ^XS' = R,,, 

where lipj is ti row vector whose elements are the correlations between the 
test scores s,-; and the primary-factor scores Spj. These are the correlations 
between the tests and the primary factor j>, and hence they are, in a sense, 
the validity coefficients of the tests for the primary factor p. Similarly, 

(9) ^SS' = R,,, 

where E,-* is the correlation matrix with unit diagonals.* From (7), (8), and 

(9) we get 

(10) Rp, = ; 

and from this we have the desired equation, 

( 11 ) RviR7H^ = Wpk, 

whore Wph (or iVpj) are the desired regression coefficients in equation (1). 

Equation (11) iius interesting interpretations for statistical and psycho¬ 
logical problems. In order to determine the regression weights w, we need 
the inverse, Rj^, This inverse does not exist if E/* is singular. Hence the 
corrolatwm matrix E,* with unit diagonals for the independent variables 
must be of rank equal to its order. The number of terms in ITS of the re¬ 
gression equation (2) is equal to the number of independent variables. 

If the situation should arise in which a set of supposedly independent 
variables is not linearly independent, then the inverae, Ef*S could not be de¬ 
termined. In dealing with experimental data it may happen that the inde¬ 
pendent variables owe their linear independence to fortuitous variable 
errors. If the variable errors were then eliminated, the set of supposedly in¬ 
dependent variables would no longer be linearly independent. If, in spite of 
such a situation, the regression equation were computed with as many re¬ 
gression weights as there are supposedly independent variables, we should 
expect to SCO absurdities in the regression weights. They would express only 
the fortuitous variable errors. This situation is not unlikely when a regres¬ 
sion equation is written in terms of a large number of independent variables. 

The difficulty with correlated independent variables whose true rank may 
be less than the order can be avoided by an application of multiple-factor 
analysis. The correlation matrix for the independent variables should be 

• The unit are called for here because we are now dealing with a convention¬ 

al regression equation. 
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factored with reliability coefficients in the cliagonals. These diaconnl« • 
elude not only the (3ommon-factor variances of the indenendeiit^vn^ 
but also those parts of the unique variutuiea which tlie independent vari'a 
may share with the dependent variable. These diugonul.s delude W ^ 
the unreliabilities of the. iiulepcndent variables. When the residuals ? 
judged to be vani.shingly small, the luimbor of faetom is also the mZt » 
to,™ written in 

Having determined the number of terms which cun be written in tli* 
gression equation, one proceeds ne.xt to arrange the independent varLbll' 
the same number of groiip.s as there are number of terms in TP,S' which is 
afeo the rank of the independent variable.s. Tht! grouping .should be dol; 
that close y correlated variables are in the s'anie groiplI 
new .set of independent variables can then be written as centroids of the 

‘r indeiieiiflcnt variable.s /fy* in equation 

(11), with unit diagonals for determining the r weights wj t.* 

In application to a p.sychnlogipal problem, equation ”(11) Kive.s rpHiilt«i 
winch are of theoretical, as well as of practical. inte.r('.st. Suppose that the 
number factor N is to bo appraised by a large battery of te.st.s which renre 
sent several factor,s. If the iiistructions for the number test.s include sLn 
variance on the vorlial (lomiirehonsion factor V, then thi.s factor will have 
small saturutum on the number test.s. In writing t lie regrc.s.sion equation for 
the apprai.snl of the number factor, one might find a small negative rem-es 
Sion weight on the verbal factor F. The in?erru-etatirth«^^^^^ 

N and"J“" ‘‘'"“‘’““I*"’" the number te,st composite 

N. and the verbal te.st composite V„ in which the number te.st eoZ 

t 7 " n It is as if thrnu£ 

I o r 'Jeterinined from jV and V by .siihtraeting a correction for 

of we2 ThTm ••■'•^trutfve of the .systL 

weights that may arise m a complete solution for prinmry-faetor scores 

M 7' ta.st,s in a diversified battery ^ 

r,.nhi , by some students of factorial theory to this 

I^roblcm ot appr.,ri„g the primory-fnetor «,oro, „t individ„ah oSm W 

oisnte but ta nrf'T“‘T (U) tor llio roBresaion coriS- 

use tho&^J - even desirable to 

variants, presuppoHos that a complete 

th^teate L onebV^^^ i.s desirable that 

the teats for each factor be oa far as poasible self-contained, so that a subject 

hie monogreph°,StatoiMz7o««J^^ 1" a different setting by Ilagnar Frisch in 

(Pub. No. 6 [University of oL Eoon3”nstitSn93^^^^^^^ Regression Systems 
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can be examined for one factor without corrections for the other factors 
which may be irrelevant for the occasion. In order to prepare tests to satisfy 
this requirement we merely select several tests which have high saturation 
on the de.sired factor, and the score in such a composite may then be used in 
practical situations as the subject's factor score. The additional refinement 
that could be brought into the appraisal by giving the tests for all other 
known factors in order that a regression equation might be solved for each 
individual for each factor is rarely, if ever, worth the extra trouble. In most 
situations this complete procedure would even be absurd. 

In selecting the subtests which are to constitute a composite test for any 
primai'y factor, it is useful to distribute as fai- as possible the variances on 
the factors which are irrelevant for the composite. Thus in subtests for a 
composite to appraise the space factor S, the several subtests would prob¬ 
ably be found to be impure, in that each of them would have some variance 
attributable to verbal comprehension V in the test instruction, to the num¬ 
ber factor N if a part of the task induces numerical thinking, and so on. 
Now, if all the space tests had an appreciable secondary saturation on the 
verbal factor V, then evidently the composite would represent a linear com¬ 
bination of S and V with major variance in S. This effect is reduced by se¬ 
lecting the subtests so that the irrelevant variance is scattered among differ¬ 
ent factors. 

When a test composite for a primaiy factor has been selected, it can be 
used as a test for the factor in question quite independently of test com¬ 
posites for other primary factors that may or may not be given to the same 
subjects. It should be specially noted that the correlations between the test 
composites for the several primary factors will generally have higher inter¬ 
correlations than the primary factors themselves. Further, if the primary- 
factor scores are estimated by the regression equation (1) for a factorially 
diversified test battery, the correlations between such factor scores may be 
expected to be lower than the correlations between the corresponding test 
composites. Nevertheless, the problem of appraising an individual as to 
each of several factors is best solved in the practical situation by using a test 
composite for each factor. In theoretical studies of the intrinsic correlations 
between the factors it is preferable to use the more complete factorial meth¬ 
ods previously described. 

We turn next to the other regression, namely, to predict the test scores 
sji when the individual factor scores Xpi are known. 

The regression s on x 

This regression implies that the primary abilities of an individual are 
known and that it is desired to estimate what his performance will be on a 
test with known factorial weightings. This is the reverse of the previous re- 



616 


MULTIPLE-FACTOR ANALYSIS 


gression x on s, in which it wjw assumed that an individual’s scores ai'e 
known and that his primary abilities are to be appraised. 

The ease in which i.s to be estimated by Xp, van bn written in the form 

(12) Sji “ w -f‘ fji I 


in which the notation is the .same as in the prc,viou.H case. Uy similar reason¬ 
ing we get, for the rcgrwsion (‘oeflicu'nls, 


(13) 


u</p ~ Rjphj^ 


The matrix Rjp is of order «Xr, and it .show.s tlie (‘(trn'lalion between each 
test j and each primary factor p. These correlations are, in a scn.se, validity 
ooeflicienta, bccauHc tlu!,se are the bc.st available, correlations between the 
tests and the factors that the tasts arc intcnilcd to appraise. The matrix 
li'i} is of order rXr, and it is determined frmii the. intcrcorrelations Rp,. The 
matrix Rp,, has unit diagonals bncau.se it shows corrclation.s between factors 
of unit vaiiance in the common-faebir space. Sini'c f he [irimury abilities are 
linearly indoptindent, it follows that the rank ttf /fp., is ?• and hcncc. that 
is non-.singular. 

If the primary abilities are uncorrclabsl, the matrix becomes nn 
identity matrix and it.s inverse is then also the idtoilily mafrix. Tlie regres¬ 
sion weights then hecome. 


(I'l) Wjp ~ /i'„, ~ /•' tortliogonal ea.se); 

and ill this ea.se the regre.ssion weights are, in fact, t he elenienls of the facter 
matrix F, whose elements show the correlations between the tests and the 
orthogonal unit reference factors. The corresjuuiditig regrcs.si(in crpiation for 
the 8imple.st eiuse in which all the c<»iilributing factors are common then is 

(15) s/f = RjpXp, (orlhogonal ease), 

whhih is also the fundamental ob.servatinn eijiialiim willi which we started 
the (leveloiunent tif miilliitile-factor lliinry. 
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centroid; see Centroid axes 
co-ordinate, 38-43, 89, 93-96, 99, 130, 
181, 104r-95, 347-48 
factor, 120-21, 473; see dko Reference 
axes 

fixed orthogonal, 327 
least-squares, 149 
principal; see Principal axes 
Inference; see Reference axes 

Barnard, Raymond W., 356 
Bartky, Walter, 474 
Battery of tests; see Test batteries 
Bi-factor method, viii 
Bimodality, 325 

Bipolar factor, 121, 182, 189-90, 103, 
216-16, 383 

Bipolar simple structure, 189-90 
B 6 cher, Maxime, 1 
Bounding hyperplanes, 343 
Box problem 
domain of, 360 

effect of sdeotion in, 440, 453-64 
first- end second-order factors in, 415-16 
invariance in 
configurational, 364-66 
factorial, 360-61, 369-76 
simple structure in, 329-31 
spherical model of, 140-44 
static and dynamic faotara in, 346-46 
successive approximation method in, 
386-96 

British factorial analysis, 273 

Brown, William, 271 

Burt, Cyril, Ix, 273, 487 ^ 

Caleulus qf Observations, The, by E, T. 

l^ittoker and G. Robinson, 46 
Canonical Matrices, by H. W. Turnbull 
and A. C. Aitken, 1, 612 


01, 304r-6, 315, 318 
actor theory, 65, 67768 , 322, 326 
lut factorial popidation, 324-26, Sd7 


Categories, descriptive, as traits, 328-29, 
347 
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Coll nf a iiiiitrix, 2-3 
Cell nntrira; xcn EIkiiii.'iiIh 
Ceiitrul axis, 22'), 232, 211 
Central fiuttor, 180 

CViitral intellective factor of •Spearinaii: 

see Cuiienil factor, iSpenrtnaii's j/ 
Centroid 

co-ordinates of, ir>l-ri3 
deli lied, Ifil 

distance from nri|;in of, I.'i2- ri3 
locution of first uxia lliroiij{fi, Ifil 32. 
178, 361-02 

of reflected coidiKurat ion, lo l riS 
Centroid axes 

first, Mfl, 133, 301-02, 378 «!), •Il.'i 
ortliORoual, l 7 l 

projections on, 131, 217 -ltl, 225. 251, 
2117-08, 302 

relation of, to priticiiial axes, 140, 177- 
70,225,302 

use nf, for faetnrial interpretation, 302 
Centroid-faetor loadiiiKs, 152 54, 157 -,5U. 

101-03, 107,170, 270 
Centroid-fuetor matrix, 167, 1711, 101,231, 
285-87 

Centroid-faetor rcsidimls, MO, 154 50 . 

103-03, 107 < . . 

Centroid fuotora, 152 53, 1.57 50, 232 
Centroid forimdne, 2!I7-3(H1 
Centroid mctliml of fuelorinu 
complete, 161-70 

c""}j;«tfiliuiu»l proceilure for, 157-50, 
101-70, 173--75 
diagonal entries in 

kiiimm coniiniinulities iw, 107, 171. 
173 

true cuiiiiiiiinalities u«, 107-7(1 
unity In, 103, 173 

''nkiiowncoininmmlilieBas, 153, 150, 
101| ICii 

factor Inoilinga in, 152-3*1, 137-30, HU¬ 
GS, 107, 170, 270 
group, 157-01 
multiple groufj, 170-75 
numerical examples of, 157-70 
Pfmcjpnl-ftxcs solution versus, 177-78, 

reflection of test vectors in, 153^-57,100- 

residuals in. Mil, 134-57, 103 03 
sign ehunKeHiii, 103 *57, 100 417 
Hiui|ilificd, 1,511 

sums of ciioUieieuts in It, 150, 152 
theory nf. Mo -S3 
with unit rank, 278-79 
Centroid tlioorenis, 140-53 
Centroid vectors 
linear indopendenco of, 171. 175 
projection on, 217-10, 251, 207. 327 
reference, 327 

Characteristic detonninant, 27-28, 470-77 


ijliaraetnrislii; Cfiualiim 
roeUicirnts of, 27-28, 470-77 

di.rmfsi.20-2S ‘''•*''’77 

•^■4-4-'!. 476- 

r.Hits of. 41-15, 477 70, 483-84 4 R 7 ni 
4!H -97, 300-503 ' 

Cimrafterislif iniilrix, 27-28. 47fl 
Clierk 

on Clniiiiufaliiiim after rotation, 210 221 
im linear mrle,H*iideiiee nf pl«„cj,, 238-39 
Circles, great. 132 
Cluster analysis, 314 45 


Clusters nf tests (see also Configuration* 
Ciiiistellutions) ® 

'•nmiimiiulitics, 207-09 
ill idealiliealiini nf priiimry fuctora, 344- 


isoluted. 181 R'l 

Ineatinn nf refereneu friiiiie liy, 284 
111 multiple groiiii iiinthnd, 170-75 
Mil Hjiherieal iiindel, 127 -30 
ill vector iiuhIi-Is, 120-27 


CliK'llicieuts 
nf idieiiatinii, 3tJH 

nf eliuraclerisl ic enuntinn, 27-28, 476-77 
enrreliitinii; sre Cnrrelatiim noelliolcnts: 
I'lieinr loadings 

regiesHinii. 39. 01, 179. 504, 311, 510 
ridiididilv, 83 
lest. OH 00, 71 73, 811 
validity, 327, 510 
Ciifiietnr, 7 


Crditiieiir iiiethnd of i‘Htiiiiatiiig ciim- 
muiialitiisi, 306 
Cnluiiiii vecliir, 14 
Cninitiiiii-fnctnr spaire 
ciMiniinnte axes in, 95, Kxi 
ilelined, 98 

inveslignlinii nf, 176 *77 
loss Ilf iliiiieiiHioiiidity in, 230'-l() 
iwisitive reginii of, 342 
Hepiiratiim of, from unioiie epace, 84-85 
159 01, 282 

Cniniiiiiii-riietiir variance 
analysis of, viii, 170, 272, 2H7, 410 
enuiiMiiiiality iw, 75, 282 
nml enrrerticiii for aiiir|neiiesH, 140 
delined, 75, 282 
notntinii for, 85 

mill risliieed nirrelutiim matrix, 81, 420 
and risliicnd fnelnr matrix, 70 
reliitinn nf, tn iituiiiie varianee, 75, 84- 
85, 282, 442 
and unit rnnk, 272 -73 
Coinruoti fuelors (sw also Primary factors) 
HimlyHiH nf, 55-50, 00-4)2, 170-77, 179- 
81, 28-1 

change of, tn siiccific factors, 361 
contrihutinn of, to variance, 73-70,179, 
340-41 
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defined, 73, 182 

as explanatory concepts, 117-24 
extent of extraction of, 2!)S, 509 
extraction of; see Factoring methoda 
first-order, 411-30 
general, 130 

identification of, 176-77, 282, 324-27 
incidental, 437-3!) 
indctcTininate, 440 
invariance of, 300-70 
linearly Independent, and rank, 82, 282- 
83 

notation for number of. 85 
number of, determined by n teats, 82, 
07-08, 262-65, 201-04, 307-11, 440 
population matrix for, 356-57 
postulation of, 73 
rank as nuinlier of, 82, 91-92, 282 
Bccond-onlcr; see Second-order factors 
single, 259-05, 284, 289-01, 297 
and unique factors, 73-76, 98, 159-61, 
282 


Cominunality 

adjustment of, for each factor, 204-90, 
311-14 

in Burt's inetliod, ix 
in centroid method, 153, 159, 161-63, 
167-70, 173 

as complement of uniqueness, 75, 282 
defined, 74-70, 282 
in diagonal inetlind, 103,107 
effect 

on factor matrix of, 282, 205 
on rank of li of, 282, 484 
of selection on, 450-53 
exact solution of, 308-9 
geometrical interpretation of, 99, 120, 
282 

in Kelley's method, viii 
known, 167. 171-73, 312-13 
methods or estimating, 282-83, 294- 
307, 314-18 

in multiide group method, 171 
multiple solutions for, 309-11, 317-18 
notation for, 85 

numerical example of effect of high or 
low, 285-87 
for primary factor, 413 
in principal-axes solution, 484, 609 
relation of 

to rclialiility coefliciont, 83-85,282,287 
to side correlations, 282-83, 286, 289 
in single-factor inetliod, 274, 284 
In Spearman's method, 266, 274, 284 
in tetrad difforeneeB procedure, 266, 284 
trace of correlation matrix os sum of, 287 
true, 167-70, 295, 312 
uniqueness of,- 207-11, 317-18 
unit, 122, 361-62 

and unit rank, 269, 262, 264, 266, 274, 


277—79 284 

unknown, 167, 171, 173, 266, 282-318 
use of, 86, 91, 98, 176-77, 282-318, 484 
zero, 334 


Complete centroid method, 161 -70 
Complexity 
defined, 320 

effect on factor matrix of, 326 
of measurement Sf, 320 
as number of oommon parameters 320 
of primary factors, 332-33 
of test, 108, 320, 326, 328, 333-36, 351 
of teat battery, 320 
Composite 

factor variable, 460-64 
matrix, 301-4 
score, 327 

test, 69, 288, 327, 514-15 

Cone configuration, 93, 183-84, 343, 
354-55 

Configuration 

acceptance of, for interpretation, 212 
alternative simple structure for, 329 
in bipolar simple structure, 189-93 
centroid of, 151-66 
characteristics of, 91-96 
cone, 93, 183-84, 343, 354-65 
constellations in, 184-86, 297-99, 301, 
314, 344^45 

correlational, vii, ix, 327 
defined, 91 

dimensionality of, 448 
effect on 

of adjustment of planes, 250 
of selection, 444-45 
of treatment of scores, 369 
ellipsoidal, 445, 448 
with estimated communalities, 312-13 
and factor matrix, 98-99 
and factor patterns, 176-93 
factorial invariance and, 362-67 
fan-shaped. 607 

insertion of reference frame into, 91-92, 
08 

invariance of, 364-67 
isolated, 184 
location in 

of first centroid axis, 161, 361-62 
of principal axes, 362 
in method of extended vectors, 225, 229 
principal axes of, 177 
random, 182—83, 339 
reflection of, 153-67 
relation of 

to correlation matrix, 91-92 
to factor matrix, 98-99 
rotation of: see Rotation of axes 
simple, 58, 328; see also Simple structure 
simple structure in: ses Simple structure 
spherioal, 127-^9, 444-46, 448 
spherical models of, 127-48 
three-dimensional, 125-27 
trait, 327-28, 334-36, 344r-46 
triangular 

complete, 184r-86, 192, 364 
incomplete, 185-87 
true, 31^13 
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Cniin(;iirafi(i]L —conlinuKd 
twii'(lim«iisi(inul, lOH-lO 
typi's t.r, 1H2 !)3, 338 -3!), 312 
uni(iiieiiesH of, ilU, <l(i, 2!t3, 33'l-<i() 

V(>(,;tipr nidtU’lH of, 120-27 
ColirtKiii’jitioiial invariHiicp, viii-ix, Hn'l—fifi 
CoiiMtdliitiniis 
(IcfitU'il, !M*1 

iKoltitfil, IM -ari, 314 -.lo 

of i<iiiiiliir 2!17-111), iHll, 31-1 
tliniMtniftv!, iili'ul, ol-of), 7tl 
Coiivim'iii|;;tifs.s of 
Ii.VpMtlit;.S(‘.s, 1K2, 2!II 
Iiriiimry faftniM, 337--33 
siiiiiili! Ktruotiiro, 1K2, 333 •10 
Co-orilinutu axi's, 38-13, 87-8!), !13--!Hi, '.HI. 

130, 181, lOl-OS, 317 -18 
Co-oi‘iliiiatc.H 
iiiiKiiiuntcxI, 31!) 
rciitroid, lOl-ilS 
elciiiuiiU in matrix iik, M, 87 
Copliinur method of c.stiniiitiiiK eoin- 
iiiii»uliti(‘)i, 300 
Correction 
fur attemuitioii, MO 
of movement)! of itlum')! in rolnlion. 

203-10, 211-01 
for mihinone)))!, MO-17, 208 
Ourrolnlion coeflinients 
miKiimnlud, MO, 310 
corrected foe miUnicnosx, MO 17, 311 
elTect on 

of nornialiKinft KCor<!s, 03 07 
of Holection, 111- 00, lOl-li!) 
of BiRn rnvei'.'iiilH in /■'-inalris, 00-ll? 
fulliliility of, 101, MO, 200-01, 201, 283, 
200, 500, 008 

Reoinetricnl interjiretritioii of, 8!) -01 
iiifaUnde, 200 
liiiciir e.xprnsHion for, M!) 
neRativn, 01, 103, 307 
notation for, 80 

number of independent coiiditiotiK in, 
311 

partial, 44'J 

positive, 01, 03, 07, 'J!), 120, 200, 311-13 
in rank one, 200 

relation between iliuRonal and Hide, 
01, 282-83, 280, 280, 201, 310 -20 
relation of, to factor loadinR.s, 0.5,281 
re])ro(lnction by factor aimly,*<iH o^ 281 
residual; sac Itcsiilnal)! 
as Hcalur iirodiiets, 8!) -ill 
HiRii of, 01, 03, !)7, 00, 118, 120, 311-43 
Speanmin’s hicrarcliy of, 273 
sum of, in li matrix, 100, 102 
suiiimational foi-in of, 77 
ua symbnl of iRiiorance, 13!) 
and unitary factors, 343—14 
uao in factor analyaia of, 07, 63-G4, 70- 
82, 12!)-40, 308-69 
zero, 91, 120 


Correlation matrix 

76-82, 101, 129- 

bordered, 407 

comiilotc, 77-82, 80, 282 

deliiiBil, 70, 03, 328, 473 

diiiRonal entries of; «rt! DinRonid otitrios 

eneet nn 

of .siRii reverriids in factor matrix. 96- 

liT • 


Ilf lUlu 

element itf; mr fttrrelatioii Couflicients 
estimation of eoinmimalitic.s tor. 204- 
:0)7 

faetor matrix as interiiretution of. 87- 
8!), l):i-0!) 

faetoriiiR; .see I'nelorinR methods 
Reoinetrieid interpretation of, 87-92. !),5 
00, 125-20 ’ ’ 


(irniiiiiin projierties at, 82, 282, 286-81) 
Heywond lU'-e of, 28!) -01 
in.speetion of ilii.ster.s in, 31-1-1,5 
iiiterunluinnar 
correlation in, 2(in -01 
proportionality of, 2,59-02 
notation for, 8li, bts 
mimlier of faetor.s in Riven, 202-04, .506 
mimber of independent eocIlieientH in, 
203,311 

order of, 82, 282, 280, 328 
of primary faetois, 138, 3.51, 111, 110 
proiiertiesof, 70 82, Ot, 187-!I0 
rank of; ,srr Hank 
of Dink one; tint Unit rank 
reduced, 70 -82, 8fi, 282 -83, 308,111-14, 
420 

relation of 

to coiiliRiiralitm, 1)1 02, 12.5 
to factor matrix, 70-82, !)2, 0.5, 109, 
281 


to primary vector.H, 3.53 -.51 
to hcc)i'(! matrix, 77, 93, .505 
repHsluction by factor aoulysia of, 284 
.sectioninR of, 2()1--1,101-00 
after selection, .l"i2-,50, ICvl-OO 
side eiitric,s in, ill, 282-83, 280, 289, 292, 
310-20 

Slim of all eonllicieiils in, 1.50, 152 
uniitue eonliRiiratioii of, 203 
uiiKiiiuue.ss of .simple slrueture in given, 
3:11-10 
unit, 411-12 

of unit rniik; see Unit rank 
vector inoclei.s for, 12.5 -27 


Oorrelationiil conliguratifui, vii, 327-29 

Correlulions 

liRtween 

caeli lest and caeh iirimary factor, 327 
mental teesUs, 00, 118, Sll-!.’!, 411 
primary factors, 78, 137-44, 212-15, 
228-20, :i20,3rtl-.50,4U-39,467-68, 
470 

set of tests and particular test j, 95 
test com]) 0 .sites, 616 
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test j and refereni'e vector A, 474 
tost j and single-euinmon factor, 203 
tests and general factor, 422 
determiners nf, 325 
effect of selection on, 444-60, 464-00 
multiple, 5S)-0(), 68, 17!), 327, 604, 611- 
10 

negative, 01, 03, 00 
notation for, 86 
partial, 448-^0 

piiHitive, 01, 03, 07, 00, 120, 206, 341-43 
self-, of pure testa, 352 
true, 146 

zero, 91, 130^0, 321, 341, 436 
Cosine 

of angle between 

primary and i-eference vectors, 362 
primary vectora, 304 
reference vectors, 130, 204, 226-28, 
241, 251 

test vector and reference vector, 132 
direction; see Direction cosines 
as scaiar product of two vectors, 37-38, 
126-20 

as scale in plotting conOgurution on 
ai)here, 132-37 
Covariance 

of paruiuutui's and inental abiUtics, 139, 
322 

of raw scores, 300 

after selection, 447, 463, 466, 406-08 
CuvariaiiGo matrix, 463, 466, 408 


Criteria for 
acceptability of 
factorial method, 301, 376 
factorial solution, 204, 324, 336-40 
hypotheses, 187-88, 210,266, 291, 324 
determining reference vectors, 334-35 
diagonal entries, 284 
factorial invariance, 360-63 
gnmping of teats in multiple grouii 
method, 171 

intercoluinnar correlation, 260-62 
interoolumnar proportionality, 200-62 
maximum variance, 177 
reference frame 
anaWtical, 377-78 
configurational, 178-81 
grapnical, 108, 176-79, 196, 334-36 
statistical, 178-81 

reflection of test vectors, 163-64,106-66 
simple structure, 334-40, 365-66, 377-78 
single factor by Spearman, 260-02 
tetrad, 271 

unitpie configuration, 178-81, 293 


Criterion 

in motliod of minimizing weighted sums, 
399 . . 

prediction of, by regression equation, 88 
of science, 62 

variable, in selection, 443-63, 458, 404, 
470 

Crossroads in the Mind of Man, by Tru¬ 
man L. Kelley, ix, 203, 309 


Curve-fitting, 308 
Cylinder problem, 117-124 


Data 

oharaoteristics of, 375-70 
of factor analysis, 67, 03, 101 
factorial Interpretation of, 378 
fallible, 101, 200-01, 300-301, 606, 608 
treatment of, 177, 376-70 
Degrees of freedom, 62 

Dependence (see also Independence) 
experimental, 441-42 
linear; see Linear dependence 
Derivatives, partial, 322, 475 
Designs test, 360 
Determinant 

oharaoteristio, 27-28, 476-77 
eofaotor of, 7-8 
of composite matrix, 302-4 
defined, 5 
diaranals of, 3 
eveduation of, 0-9,11-13 
of hierarchy, 290-91 
of a matrix, 3-13 
minors of, 6-7 
order of, 3 

of product of two matrices, 20 
propeities of, 3-13 
term of, 4r-6 

of toansfonnation matrix, 40, 479-80 


Diagonal 
principal, 3 
secondary, 3 
Diagonal entries 

conununalities as; see Communality 
in correlation matrix of unit rank, 250, 
202, 274, 277-81, 284 
criterion for determination of, 284, 287 
geometrical interpretation of, 137-38 
in Heywood case, 289-90 
in Hotelling’s iterative method of fac¬ 
toring, 484 
imaginary, 308 
in KeUey’s work, viii 
known, 101-5, 170-75 
positive, 290 

in principal-axes solution, 177-78, 484, 
509 

and rank, 82, 282-87 
reliability coefficients as, 83 
in Spearman’s single-factor method, 274, 
284 

Bi*® nos 

grcfttoT th&n coinniunflJitioSi 2Ho 
greater than unity, 202, 289-90 
high and low, 284^7 _ 
less than communalities, 286 
less than unity, 284, 286 
^ty. 98, 17flhV7, 284rS7, 291, 484 
as stretoHing factors, 132 
in tetrad diSerence equation, ^ 
nniquo factor contribution to, yy, oai 
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Diagdnal enltwit—riiiiiiiinnl 

unknown, 110 If,, i jo (i7, i!s;j 

variable, 287 

DiaKonal uiatrix 
dcfinwl, 21 
tyiM;.s of, 21-2:i 
UHC of, 132, I37--38, Hfil .IS 
Diagonal inelJnal of far toiing, loi-I7 .'.. 

Dirkson, L. 10., I. .M 

Dimetisionnlily (urmlm Hank) 
angmcnUnl, 121-22 
of cnniiguralfoii, !»l ' 12 . I'li 
of fimt-ordcr ilniimiii, .m i.i 
loss of, 201, 230 '10 
of Hucninl-onler iloiiiain, ■II1-2I 
of total test «iiace, 1711, -Mg 
Direction cosines 
tlelincil, 34 
of normal 

35. ‘-120 27. 23S :w, 

to Kcnro Hiirface. 323 21 
injsitivo, 216, 342 
in iioHitivo region, 342 
of primary vectors, 1311 38. 228, SSI 
of pnncijial axes, 477 -70 
proiHirty of, 3.1 

“'A m'S”"*™ 

in trunsforiimtion matrix, 38 43 
of unit test vectors, 137, 341) 

DirccUon nninbcrs, .K), 227, 3^3 8.1, 3)18. 

Dispersion, iiicnsurcs of, 368 
Distribution of ability, 02 - 66 , 32.1, 367 tti 
Disturbers of tetrad ccpiation, 273, 473 
Dumaiii 

‘‘'32™-3r «tr"'!tiires in sainc. 

defined, 55, 32(1 

37^^76 Siil- 2.1, 3-10, 

“f. 71-72, 177-81, 313-14, 

^* 411 -^’”^"“™ I-oi 'lcr, 

of statiaticnl inetliod, 261 

pnuble-group mctliod of rotation, 4(18 -lo 
Doublet 
defined, 182 

““""nunalities, 266, 

occurrence of, 363, 441-42. 468 
second-order, 417-18 
Dresden Arnold, 1 


Kli'iiieiils 

nf (■orn*liifi(.n inutriv 71 r,. 

f'orielafiMn (VTodicumts 
of rliiiK..iuil inulpix, 21-2'i 
f*f ftir.eor inufrix ..i *, 

loadings ' Factor 

"f nmlrix, 2 
n••)nl)>•ll fur, 13s 

of |a<|oila(i.in matrix, 6,8, 71. ;,r;ri 
of snin-iimliix. 68 

nitilary, 313 11 

'■'''''T/i'iiri'ir'"''"'*’’''i»K 

I.*... 


IvinutiMii 

.■bnrapen-tn.; .r,. C’liaructcristic equa- 

fiimlimientul factor flicorpm, vi, 77-81. 

f'ludaimilnl observation. 68, 71, 325, 

grapliical reim‘srii(a(i„„ „f 
of liy|K*riilimi., .st-.qr, 
of luif. 33 .31, .p.i!) 

Iiiionr, 33 38 

^''llTwa' 411448- 
iiormnl f,j^rin of, 3i 3.'-, yyn, 47, 
notation for ' 

••8|Himlisl, 13, Hi 
luatriv, 11-16 
rivtungulur, 14 l.i, 17..18 
wjmiimlioimi. 11 111 , 2 H -31 
of oblniii). siinpln structure, B.'il-.'iO 
(Hm-Iy’lli.'y formnla, 446-,'’rf) 
pitrliul corri«|jili..n forimila, 41fP 50 
of pinne, 31-31 
ralioiiul, 12 
rcgre.scioii 
H on r, 111-in 
X mis, 111 .- 1,1 
for Hcr.rn Hiirfiiees, 322 
siiniiltnnaniH, 13 -18, 261 
of sloia; of line, 33, 466 -.KK) 
of test vector, 148 
Iclrad-rlifreruiice, 26 , 1 , 273 , 263 

of Irnce, 220 -27, 241 
x-eclor, 231, 236 
lirnir 

c,\iK‘iiiiieii(al, 146 

riindom, 73. 83. 261 

snnipliiDr, x, 2(Hl () 1 , 264, 283 

standard, 261. 267 

uncorrcintisi, 73, 83 

variable, 73, 83, 286, 366 7, 101, 508, 

Kmtr factor, 73 -71, 83-80, 140 
Lmn-wfactor variance 
and correction fur uttemiatinn, 140 
notatmn for, 8,1-80 

73"7.'j, sa-ai, 286, 605, 

iaJo 
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and reliability, 84 

separation of specific' factors from, 73, 
84, 286 

Essential Traits of Mental Life, by Tra- 
man L, Kelley, vlli, 287 
Experimental dependence, 441-42 


Eactor analysis 

assumptions in; see Assumptions . 

British school of, 273 
data of, 57, 63, 376-76 
and distribution of ability, 62-67, 325, 
367-69 

criteria of acceptability in; see Criteria 
domain of, 55-57, 313-14, 324r-26, 375- 
76 

and empirical prediction, 56-62, 237, 
332 

exploratory nature of, 66-57, 250, 266, 
287, 320-27, 332-34, 340, 365 
and faculty psychology, x, 56, 70, 145- 
46, 177 

first approximation in, 54-55 
fundamental concepts in, 328-26 
fundamental equations in, 68-86, 146 
fundamental postulates of, 62-03 
ideal constructs in, 70 
ideal solution in, 179 
methods of; see Factoring methods; Ro¬ 
tation of axes 

and multiple correlation, 59-62, 08,170, 
327 

parameters of: see Parameters 
planning of, 176, 313-14, 376-76 

ose of, 66, 02, 70, 02, 149, 170-81, 
6 , 340, 348, 300, 375, 471-72, 603-8 
as a scientific method, 310, 338 
steps in, 101, 283 
texts in, v, viii-ix 

uniqueness of solution in, 92-93, 178, 
180, 329-34 

Factor Analysis, by Karl J. Holzinger and 
Harry H. Harman, viii 

Factor Analysis to 1940, by Dael L. Wolfle, 
ix 

Factor axis, 120-21,473; see also Reference 
frame 



Factor loadings 
augmented, 131 

centroid, 162-54, 157-59, 101-65, 167 
170, 279 

common-, 73-80, 146 
contribution to variance of, 68-86 
defined, 71, 73 
effect of 

adjustment of planes on, 249-51 
selection on, 360, 369 
error, 86, 146 
extended, 225 

geometrical interpretation of, 89, 99 
in Heywood case, 289-90 
invariance of; see Invariance 
maximum variation in, 362 


negative, 96, 365, 368 
notation for, 86 

number of linearly independent, 202 
In^riuoipal-nxes solution, 149, 473-01, 

as projections on co-ordinate axes, 80, 
281 

reference abilities underlying, 68-69, 325 
as regression coefiicients, 179, 504 
relation to correlation matrix, 95, 100, 
281 

single-common, 259-65, 270, 273-78, 
279-81, 284, 289-90 
in Spearman’s formula, 263 
specific, 86,146 
unique, 78, 86 

zero, 89. 147, 181, 292, 324, 340-41, 
355-66 


Factor matrix 
augmented oblique, 422-27 
centroid, 167, 170, 104, 231, 286-87 
common factors in, 73-^ 
complete, 76-82, 86, 148 
consistent, 289-90 
effect on 

of oommunalities, 282, 312 
of complexity, 326 
of factoring method, 363 
of selection, 455, 468-69 
of treatinent of scores, 368-69 
. entries of, 74r-76, 87-89, 147, 181-91, 
292, 326, 334r46, 349, 377-78 
error factors in, 73-86 
extended, 225-53 

factor patterns in; sec Factor patterns 
fundamental equations for, 68, 71-73, 
76-82 


geometrical interpretation of, 87-100 
imaginaries in, 286 

interpretation of, 95-96, 69, 177, 254, 
334r-35, 349, 366 
invariance in, 363-65 
normalized, 131-33,146 
notation for, 86 

number of independent parameters in, 
177, 291-94, 307, 311, 336 
order of appearance of primary factors 
in, 256 

for principal-axes solution, 477-92, 496- 
502, 609 

rank of, 92, 97-98, 343 
reduoeo, 76, 79^2,_ 86 
reduction of, to unit rank, 268 
reference frame of; see Reference frame 
ration of 

to correlation matrix, 79-82, 92, 95, 
100 , 281 

to factorial structure, 92 
to population matrix, 71 
rotated, 135-39, 202-6, 210-13, 228-29, 
263, ^24, 326, 332, ^34, 347-63, 369, 


row of, 87 

second-order, 419 

sign reversals in, 96-97, 100 
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Factor matrix— 
and aimpio striioliiri;, 311 J.’i 
HiiiRle-coimiioti, a.T.Hia, aiW, SHfi, L’SS- 
90,188 . . , 

apooific factors in, 73 Sli 
test cueiliriiiiits in, 71-73 
transfiinimtion rnmi r)itliMK«Mii| („ 
nljiirjue, iHT-fl-l 
truna|Kisc of, 78-81 
unirpie factnrM in, 73 7(1, 79 
uniiiucncsH of, i)3, 289 •«», 313 
l''a(‘tor patterns 
clmnu'terislics of, 191-93 
corresjsmdiiiK to wmliKnraiional Ivih-, 
97, lS2-tH). 119, 111, 113 
ileiined, 191, 320 
lilTcct of acnre treatinuiiL on, 309 
first- and Bcc(tmlHirdcr, 119 
rnlo of, xi, 363 

in simple atrnrture, 181 ,82, I'K), 3f;;t 
Factor prolilein 

detcrniinney of, 81, 301, 378,173 
formulation of, xi, 70 
multiple-, 2H3, 473 
non-liiicar, .610 
single-, aso-ori 
starting.jKiint of, 3.6, 71, 92 
steps ill. 101 
types of, 310 

Factorial Amly»iii of Uitnmn Ahilil’/, The, 
&, 4tt.6 “"'• 

t'uetorial iiivurianci!; srir Invnriancu 
Factorial Sltuiica of lutcltigriicc, liv I-. I,. 

J tiurstono and 'riiclma tiwinn ‘rimr- 
slone, 402 

Factoring inelliiidri 
appliealiility of, 170 

for correlation hier- 
coiitniid’ 111, 149-7.6 

l»fincipal-axes solution, 

criterion of validity of, 281, 37,6 
diagonal, 101-7 
direct summation, 277-78 
graphical aids to, 407 -300 
group centroid, 137-00 
grouping, 111-16 

**'f)03'i§!),6^ 279, 483 ,H3, 407. 

logarithmic aolution, 277 
iimitipio group, 170 -73 
minpliliod centroid, 1.69 
”Fy^™oiu'8 single-factor foi'itiiila, 273- 

succe^ive iijiproximations, 278 7!i 
tetrad cliiTorcnecs procedure, 203 -68 
for unit rank, 273-79 
Factors 
average, 180 

bipolar, 121, 182,189-90, 193, 21.6, 303 


|■ullHJl^ive, 

••eiilral, 180 
I’eiifruid, 132 33, 232 
cmninMit; ,w Common farp.M 

dyiimiiic, ;il3 16 
error, 73 7.1, S3 86 . Mij 
lirnl-ortler. 111 - 39 

gf.|li.r,'it. sre tirii|.rul fiii-loi" u,.- 1 
order faeloiH ‘ 

Kiolip; are C.roiiji factors 

liiKhei-order, 111 

iioagiiiarv, 2Sli 

iiieidelital, 136 12. 169 , 471 

linear conihination of, (;s 

iiutiire of, ,63 ,69 

orthogoiial, 76 , 73 

orthogonal genciiil. 416 

lirinmry: arc i'rimiirv faeiors 

priiieipal, 178, 399 ' 

referniiee. 71 73. 8.6, 99 

relHliou to vnriiim 1! of, 73 

w-eomi-order; (or Secoiid.order fauhira 

(STomhiry, 273 

HIM-eilie; arc .s'ls i ilie factors 

efatie, 31.i 

third-order, III 

triplet. 182 

(.V|M‘S Ilf, IhU 

uiieorrelatml, 139 46, 111 
■illii|tie; Krr t’nitpic rnctors 
iiiiitnry, 313 11 

FacbtratiJ Mind, The, ti.v Cyril Hurl, ix 
ruitiill.v psychology, X. 36, 7(1, 143 -16, 177 
Ferrur, VV. I-, 1 

Firai rimrac in Thrnrii „f AVpmiioi,!, by 

tv. llickiioii, 44 
I'lywIiiH'l proldfio, 341 1.6 
Frisidi, Uagnur, .611 

FuiKaioual unities, .67 .68, 14.6-46, 284-85, 
.•aili -K; acc alan Primary fuctors 


Fimetions 

""fii!;**-'’*'*'*** criteria for reference frame, 
3r 7‘78 
cognitive. 333 
linear, .61 .6.6 
moiiotonie, .322, 368 69 
of jjinrniiieleis of factorial doinain, 322- 

_ score, 319 27, 30,6, 308 72 
Fiiiidaiiieiital eoncepts, 328- 29 

Fiimlniiiental eriterion of valid factorial 
imitliod, .'till 

Fimdaniental cijiuitions, (18 -86, 149 
Fimdamcntal factor theorem, vi, 70-81, 
02. 149, 170, 2.60, 3,51, 3,63-54. 350, 
604-.6 

Fundamental postulate, 63 
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fl-factor, vi, viii, 188, 271-73, 284, 421, 
439, 607 

Gaueaian "diatribution, 04-66 
General factor 

configurations involving, 188-80 
defined, 121, 182 

diflerontiatcd from general common fac¬ 
tor, 130-31 

orthogonal, 271, 273, 410-10 
second-order; see Second-order factors 
apearman's g, vi, viii, 188, 271-73, 2^, 
421, 430, 607 

General intellective factor g; see General 
factor 

Generating parainotcra, 434-37 
Genetic basis of mental traits, 333 

Geometrical interpretation of 
augmented co-ordinates, 349 
coinmunality, 87-lOU, 126, 282 
correction fur uniqueness, 146-47 
correlation cocilicicnts, 89-91 
correlation matrix, 91-96, 99, 145-48, 
282 

factor loading, 89, 09 
factor matrix, 87-100 
linear equations, 33-38 
matrices, 36-37 

number of tests to determine single 
cumiiion factor, 264-06 
primary factors, 349-52 
r<n common factors, 97-98 
reference fnctorj 99 
reflection of traits, 153-57 
residuals, 153-67 
score functions, 321-24 
sign reversals in the factor matrix, 96- 
98, 100 

simple structure, 90, 99, 130, 257-58, 
354-55 

single-coinmon-factor loading, 270 
test battery, 89 
tests, 87, 99 
transformation 
oblique, 43 
orthogonal, 38-43 
zero factor loadings, 89, 135-30 
Geometrical models 
three-dimensional, 125-48 
two-dimensional, 87-100 

Gottschaldt Figures test, 306 
Qramian matrix, 10, 304 
Gramian properties of correlation matrix, 
82, 282-83, 286, 289, 304 

Graphical methods 
as aids to factoring, 497-500 
determination of hyperplane, 377-78 
determination of two planes, 238 
estimating communalities, 306 
inspection of constellations, 344 
isolation of simple struoture, 349-50 


iterative determination of prinolnal 

axes, 497-500 ^ 

locating reference frame, 225-58, 377 
plotting of 

normalized vectors on sphere, 131-39, 
104 

three-dimensional sections, 195, 225- 
30 

two-dimensional sections, 194-224 
rotation of axes, 131-39, 205 

Graphical representation of 
equation, 14^18 
faotoiial stmeture, 99 
proportional columns, 277 
simple structure, 267-58 
test configuration, 126-39, 147-48 
tetrads, 270-72 

Graustein, W. C., 1, 41 

Groat cii'cles, 182,134, 340 

centroid method of factoring, 157- 

Group factors 

configurations involving, 188-89 
defined, 182, 421 
as disturbers, 273, 473 
and primary factors, 420-21 
projection of tests on, 422 

Grouping method of factoring, 111-16,149 



Harmon, Harry H., viii 
Hey wood, H. B., 289 
Heywood case, 289-91 
Hierarchy, 273, 284, 289-91, 487 
Holzinger, Karl J., viii, 171, 267 
Hotelling, Harold, xii, 279, 482-91, 403- 
97, 603, 605-0 
Hyperplaaes 

angular separation of, 349 
bounding, 343 

co-ordinate, 327-28, 347-49, 354r-65, 
382—84 

defined, 328, 342-43 
dimensionality of, 34—36, 226, 328 
equation of, 34-35, 354 
interpretation of, 337 
normals to, 34-39, 335 
oblique, 340, 364-55 
orthogonal,,41, 349 

overdetermmation of, 216, ooo, oao, 
349-51 
positive, 342 

positive oo-ordinate, 343, 384 
secondary, 331 

in simple structure, 327-28, 331, 336, 
342—43, 354r“66 

for the trait configuration, 327-28, 364- 
65 

Hypotheses In factor anaMs, 122-23, 
187-88, 216, 266, 291. 324-26, 344, 
606-8 



MUI/riPI.K-KArn>H ANALYSIS 


r)2(; 


Idciitily >212-21), 7S, -IKi 

Indepenrlcimc 
defined, D!) 

nxperiinnnttd, (il), 2'.ll, Dl!) 

linrnr, n3; am nlmi Line.ar d<-|ieiid(>inT 

HtiLliKtieiil, (il), )2() 

Individiml difTorcuccs 
ahilifies tia euiiiies tif, rt2, li!)-70, :)2ri 
and idcntieul teatnnireH, 70 
paruinetorti involved in, .'iS-'ili, ;i2't ‘J.'t 
at a^n, ;)') 
stiiily of, 52, .iri, 33;i- at 
IiitelliKeiiee, theories of, -tatl 
Intercoluininir eoiTOlutinn eriteiiun, 'JlUt - 
02 

IritercnUimnur protiortionulity criteriini, 
200-02 

Intcreorrclutinna; see Correlation e ef- 
rieienUt; Oorrclalioiis 
Interpretation 

of jioncral intellcetive hietiir y, 273 
objective, 145, 33R 
pluiiHibility of, 330-40 
of priiimry factors; ucc rriiiiury factors 
of reduction to unit riiiik, 2(i8 70 
of second-order factors, 414 
Hufjjectivo, 145, 338, .000-8 
of ti-uit coidiKuriition, 327 
Inturvfd, score, 367 

Inlmluclim to Alyebritia Theorm, l>v A. A. 
Albert, 1 

Intmiuclion to Iliijhcr Alycbrn, liy ^tuxilne 
DOuIicr, 1 

Introspection in fuctoriiii investiKiitiiin, 
320 

Invariance 

oonfit^urational, viii ix, 301 Oti 

criterion of, 300 

of factor loadings, 300 ■70 

of factor ])atterii, 101 

factorial, 36^76 

metric. 363-04 

nuinenual, viii, 303-64 

of scalar jiroduct, 01 

t>f BVibbftttLMy of testa, 303, 373-70 

tyjtes of, 303-07 

of weights of priinary abilities, 301 
Inverse 

cniupututhm of, 25-20, 40-48 
of u matrix, 23-20 
of jtrodnet of niatriccs, 25 
ill regression crpintionH, 513, 510 
of tranHfornmtion matrix, 137 
Isolation of 

common factors, 73-70, 81 
lirimary abilities, 73, 301, 500-8 
simple structure; sec Dimple structure 
specific foctors, 73-70 
unique factors, 73-76 
Iterative method of factoring, 270, 482- 
500, 503, 605-6 


Kelley, Truoian L., viii, 287, 203, 300 
Kelley-MViiid tallies, (iO, 308 
Kriiiieckcrs tlelta, Mil 


LiiRniugn's nietiiud of undelcrmined multi, 
idlers, 475 ‘ 

Law, scientilif, 51-55 


Lcust-s(|UureM proldem, Mp, , 504 , ijog 
Isideriuiinu, Waller, 287 SO, 444, 448 
fane 

etpiatiotis Ilf, 33-34 
slope of, 33, 218-211, 4!)!I -5(HI 


Linear comhinalion of 
eolutiitis of correlulion matrix, 95. 281 
factors, 128- 30, 147-18, 352-53, 413-14 
504 ' 


lest scores, 511-12 
lesls. Oil, 440-43 


Liiiour deiioiidenrc of 
arrays of matrix, 32-3.3, :XK1-301, 314-18 
centroid vectors, 171 
eohinins of faetor matrix, 82, 204, 201- 
114 

factors, 03, Oil, 82, 282, 412-22 
jdunes, 2:w 311 
primary vcclors, 420-22 
referenco vectors, 328 
tests, 335 

vectors, 4R- .'lO, 239 
l.incur etpiations, 33 38 
Linear functions, xi, 32 -33, 51-55, 03, 69 
Loadings; sec Kiuilor loadings 

Logarithmic solution of single-factor prob- 
Iciii, 277 

Ising rcfttrencc veetors, 190-202, 234-38 


Matrix 

udjoiiit of, 0, 25 
array of, 2, 11 
ceil of, 2 

charaetcristie, 27-28, 470 

column of, 2 

eomiHJsitc, 301-4 

correluliun; sr.e Correlation matrix 

eovuriunce, 453, 455 

dclineil, 1 

determinant of, 3 13, 20 
tliiigonnl, 21-23, 132 -38, 351-53 
dilTiiretice of two, 19 
nleiiient of, 2 
ctpiaUon, 15-19 
faetor; sec T'actlor matrix 
of factor scores, 512 
formulation of factor prublom, ix, 70, 
250-62 


geometrical interpretation uf, 36-37 
Grainian, 10 

in Ilolzinger's method, viii 
identity, 22 

inverse of, 23-20, 46-48 
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multiplication, 14-21 
associative, 19 
cross products in, 14 
distributive, 20 
non-oommutative, 18 
post-, 19-20 
pre-, 10-20 

Bumnaational notation in, 29-31 
non-singular, 11 
order of, 1-2 

orthogonal by columns, 41 
orthogonal Iw rows, 41 
population, 68, 71, 80 
positive-definite, 10 
rank of, 10, 33 
reciprocal of, 2S 
of regression weights, S12 
row of, 2 
scalar, 21 

score, 68, 71, 77, 86, 93, 324, 604^5 
sectioning or, 171, 301-4 
singular, 11 
skew symmetric, 10 
sum of two, 10 
symmetric, 10, 46, 473 
of a transformation, 38-43 
transpose of, 3 
transpose of product of, 16 
Matrix-multiplying machine, 206 
Maturation factor, S07 
Maximum variance criterion, 177-78 
Mean of test scores, 323-24, 368 
Measurements; see Scores 
Medland, Frank, 318 
Memory factor, 145 
Mental age score, 442 
Method of extended vectors, 225-58, 408, 
458 

Method of minimizing weighted sums, 
396-408 

Method of undetermined multipliers, 475 


Minors 

in estimation of communalities, 296-97, 
304, 308-9 

in evaluation of oharacteristic equation. 


27-28, 476 
first, 7 

and ideal rank of B, 317-18 
prinoipM, 6, 262, 286, 304 
second-order, vl, viii, 265-68, 270-71 
as tetrads, 265-68 
for unit rank, 265-68, 270 


Models 

geometrical, 87-100 
spherical, 127-43 
vector, 125-27 

Modem Algebraic Theories, by L. B. Dick¬ 
son, 1 

Multiple correlation, 69-60, 68, 179, 327, 
504, 511-16 
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Multiple group method of factoring, 170- 
75 

Music factor, 287 

Normal distribution of ability, 62-63, 326, 
367 

Normal to hyperplane 
direction cosines of, 34r-35, 226-27, 238- 
39,349-61 ’ 

relation to primary trait vectors, 347- 
62 

and zero factor loadings, 323-24 
Notation 
for equations 
expanded, 13, 18 
matrix, 15-19 
rectangular, 14-15,17-18 
summational, 16-16, 28-31 
for primary vectors, 348 
in scientific research, 332 
summary of factorial, 85-86 
Number of 

factors determined from n tests, 291-94 
factors versus number of tests, 82,97-98, 
291-94, 307-11, 440 
tests to determine r factors, 201-04 
tests to determine single-oonunon factor, 
262-66 

tetrads for 7i tests, 265-70 
Number factor, 73,146, 833, 514-16 

Observation equation, 68, 71, 325, 357-59 
Octants, 132,147-48 
Opposites test, 360 
Order 

concepts of imderlying, 65-66, 58, 258, 
820-38, 436 
defined, 328 
of determinant, 8 
hierarchical, 273 
of matrix, 1-2 
oblique simple, 321 
orthogonal simple, 321, 828 
and rank, 82, 282, 236, 484 
simple, 320-21, 328-20 
Orthogonality 
of matrix, 41 
restriction of, vii, 139-40 
of test vectors, 91 
and zero factor loadings, 80-01 
Osgood, W. P., 1, 41 
Otis-Kelley formula, 449-50 


irallel tests, 83 
irameters 

of abilities, 68-5^ 319-27 
alternative, 331-34 
as causative factors, 434-36 
choice of, xi, 333-34 
oomplexity as number of, 320 
correlated, 139-40, 320-21 
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Vftrainet crs" -croiJiimni 

in ciirrcliititm matrix, 291-ili, SO? 
dciiiiRd, ,'iHl, 414 
utui dri;r(!()!i rtf rrnr<dniii, .VJ 
nf domain, I«f», 211MI2, 32(1, 331-33, 
471-72 

in fuctor matrix, 177, 2lll-!ll, 3117, 311 
KoncnitiiiK. 431--37 

aromutriral renrcHimtuliim of, 127, 31!t- 

2 .*) 

idrntinratioii of, 17(1-77| 324, 3(l."t 
iiiridontal, 43()-'33 
liiioar dqiunduiH'n in, 412-111 
in linoar ncjiiutiorifl, 3-l'-3ri 
primary fucitoi'!) iia; Arc Primary faoPira 
second-order, 411-1(1 
of net of .scores, 3111-2') 
iincorndntcil, 131M(1, 32()--21 
nidrpic, 320, 332- 33, 412 

Partial correlation forniuln, 443 40 
Percentile rankn, Rl- Hfi, 308 
Personality scliednles, 322 
Personality traits, 322-24 
Plane anil ,'inlid Aiuili/lie Oi'mnitr;i, liy 
W. I'\ (Jsgood and \V. O, (iraiistein, 1, 
41 
Planes 

ttdjiislnient of, in rotation, 24i'>.*)t 
l)i‘Ht-iilting, for seoi'c surfaces, 323 -24 
clieck on indopendeneo of, 238 30 
co-ordinate, 181, 22.1 28 
ciination of, 34 31 
trace of; aee Trace) 

Piotliiig of 

norinulir.cd vcctor.s on a splierc, 131 30, 
104 

ol)liqiio rcjferenoo axes, 200 
thrce-dimnnsiotinl sections, 101, 22.1 -30 
two-diiiienHional .sections, 104 224 
Poiynoinial, roots of, 44-11 
Population 
equivalent, 300-Gl 

experimental, .11, (12, 324-20, 307, 4.18 
general, 321, 307 

selection of, ,15, 324-21, 300 Cl, 438, 
440, 4.17-.18, 471P-72 
Hlatistical, G2 

Population matrix 
for ttommtin fautoru, 71, 310 
for correhitetl primary fnctor.s, 3111- .10 
elemwtts of, (18, 71, 31(1 
notation fur, 80 
ohlitpie, 3.1(1-',10 
relation of 

to factor matrix, 71, 77 78 
to score matrix, 71 
transpose of, 77-78 

Positive manifold, 211, 217, 341-43, .307 
Positive octant, 132, 147-18 
Positive region, 342 


Predietion 

17‘) 'l(!l'''in“ 1(1 68, 

"f «c'v tests, 

and iioslnluted factors, 338, 30G-07 

Priuiury abilities (sec o(.-io Abilities; Pri- 
iimry factors) 

criteilon for valid nietlmd of isolating, 

invariance of weights of, 361 
isolation of, 73, 3til, ,K)tl-8 
in single-factor matrix, 268 


Primary fm-lor.s (-sec n/«a Common factors) 
Hpnini.s:il of individuals as to, 02-03 
32.1-27,011-16 ' 

iind constclliitioii.s, 3-14-41 
correlation between, 78, 137-44, 212-1.1 
228 32(1, 31t-.1!l, 411-30, 4.17-58! 

17(1 ’ 

correlation of test with, 327 
criteria for acceplahility of, 336-40 
ileliiicd, 31.S 

elTecl of selection on, 4.1(1 -04, 470 
exploratory .studies of, .1.1-5!), 122, 25S- 
.1|’.,^2H7, 31!) 21, 333-34, 340, 30-1-07, 

fniKluniental factor tlieercm for, 77-81, 
3.13 .14 


genetic basis of, 333-31 
iital grtiiiji faelors, 420 21 
ineiilentnl, 436 -3!) 
iiiliu'pretntioii of, 
gcoiiielrieul, 31!) -.12 
psyelmlogicul, ix -x, .1(1, 08, 122-24, 
l.-iS- 11, 141-4(1, 21(1, 268, 333, ,387-- 
40, 378, 436-4(1, 476 71 
iiivarittnec of, 333, 3(i6-'7(l 
wolatioii Ilf, .11 (17, 134, 170-81, 325, 
338, .347 K) 

liiieurly inde.peiulent, and rank, 82, 282 
naming of, .16, 14.1 
tmmimr ,V, 73, 145, 333, 514-1.1 
(»bli<iue, 63, .31-1 

order of ai)p(*aranec in factor matrix of, 

2,10 

ortliogoiiul, 63, 353 
a-sjiaraiiieters, ix, 55 -,111, 332-33, 471- 


fiiwitivo, 21.1-10 
jiredietabilitv of postulated, 338 
prediction of .scores on, 511-15 
relation of, to faelnr matrix, 71-78, 334- 
36, a 17 -54 

and Kccoiul-sinler ftielorH, 411-'3!) 
siiuce. A', 145, ,324-'2(i, .115 
theory of, .1.1- 67, 31‘) -29, 311-40 
iiucorrelated, 34!l, 411, 416 
imiiiiiencss of, 320, 332 -35, 400 
unitary, 34-1—11 
validity nf, 330-40, 472 
verbal K, 14.1, 333, 338, 361-62, 508, 
114-15 

word fluency IF, 73, 338, 508 
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Primary trait vectors, 348-54 
Primary traits, 347-52; sec also Primary 
factors 


Primary vectors 
correlated, 411, 421 
cosines of, 137, 411 
defined, 137, 348 
direction cosines of, 137 
notation for, 348 
relation of 

to correlations, 353-54 
to group factors, 420-21 
to hypcriilaiies, 347-40 
to test veetors, 352-53 
in second-order domain, 422 
of unit rank, 421 


Principal axes 
defined, 478 

diiuction cosines of, 474, 477-79 
location of, 177-78, 3Q2, 473-77, 480- 
500 

major, 286, 302-63, 415, 474, 478, 486- 
87, 503, 505-6, 508 
mean, 478, 487, 503, 509 
orthogonal, 477, 508 
as reference frame, 177-78, 284-87, 362, 
473-510 

relation of, to centroid axes, 149, 177- 
79, 225, 362 

transformation to, from orthogonal ref¬ 
erence frame, 474-77, 506 


Principal-axes solution 
advantages of, 503-10 
applicability of, 284-87, 200, 474, 503- 
10 

and centroid method, 177-79 
characteristic equation in, 44-45, 476- 
79, 483-84, 487-01, 494r-97, 600-503 
characteristics of, 177-78, 362, 473-74 
defined, 474 

diagonal entries in, 474, 484, 500 
direct, viii, 480-97 
factor loadings in, 149, 473-01, 497 
factorial interpretation of, 216, 362 
graphical aids to, 497-600 
of Plotclling, 279, 482-600, 503, 506-6 
indirect, 473-80, 484 
iterative method in, 297, 482-500, 603, 
506-6 


of Kelley, viii 

as least-squares solution, 149 
limitations of, 216, 603-10 
maximizing of factor loadings in, 149 
maximum-variance criterion in, 177 
numerical example of 
direct, 48^-86, 491 
indirect, 477-80 
properties of, 500-603 
rank in. 484 
residuals in, 403-07 
sampling-error formulae for, x 
simple-structure solution versus, 608 
squaring process in, 485^2 


theorems pertaining to, 600-503 
theory of, 474-77 
uniqueness of, 178, 474, 603 
Principal components 
of Hotelling, 482, 484, 486 
Tucker’s method of determining, 497 
Probability curve, 66 
Probability tables, 368 
Profile of obility, 611 
Projections of test vectors 
on centroid axes, 151, 217-19, 226, 261, 
297-98, 362 

as check of independence of planes, 238- 
39 

defined, 04 

into an ellipsoid, 444-45, 448 
on ^oup factor, 422 
maximizing sums of squares of, 473-74 
minimizing -weighted sums of, 377, 306- 
408 

normalized, 131-39 
numerical Invariance of, 363 
on principal axes. 362-63, 473-91 
properties of, 89, 92-06 
on reference axes, 89, 92, 196-97 
on second-order factor, 422 
on single-footor axis, 276-79 
zero, 197, 324 
Proportionality 
of arrays of matrix, 32-33 
of columns of factor matrix, 269 
in ooirelation matrix, 260-62 
criterion of interoolumnar, 260-62 
of two variables, 291 
Psychology, science of, 52, 338 


Qiiartile range, 368 

Random configuration, 182-83 
Rank 

of correlation matrix 
complete, 82, 282-86 
reduced, 82, 91-92, 282-83, 308, 411- 
14, 466, 470-71, 473, 484, 503 
defined, 10, 282 
effect on 

of diagonal values, 282—87, 296-307, 
484 

of modifying raw scores, 823 
of selection, 466, 468, 470-71 
of factor matrix, 92, 97-98, 269, 343 
of Gramian matrix, 82, 304 
in Heywood case, 289-90 
ideal, 317-18 ^ 

of matrix of primary factors, 412, 4d4, 
436 

of matrix of raw scores, 323 
and minimum trace, 287-89 
and multiple solutions for communal- 
ities, 309 , ,, \ 

as number of independent factors, 291— 
94 
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Hank*—rojifiiiiifti 
and onlnr, S2, 2,S2, 28(i, 484 
rcductidii in, 201 , 23!l- 4 (), 2 (i',) 
of HPWind-ordor iloumiii, 411 14, 417- 22 
of the Hide eiirrelatioiiH, 282 
of .Siienriiinn liierareliv, 273 
trial, HOS 

unit; we Unit rank 
Kero, 2U() 

Hank one; we Unit rank 
Hank order, (>4, 3fi7- fill 

Hcfereiice nhilitiea 
correlation hutwcen, 78 
defined, 0 !) 

in factorial forniidation, (l 8 - 7 (i, 78 

notation for, 85 

oblique. Oil 

orthogonal, fill 

imstulation of, ,51 -.511, fi 2 -fi 7 

relation of, to factor loutiiogji, 73 

Heferciine axes (nea also Heference frame: 
Heferenee veetora) 
defined, 11)5 

delnnriined by score surfaces, 321- 22 
independence of, IJd -111 
location of 

with roBiKicl to cenlrohl, 1.51-52 
, liy unitary factors, 311 
olilhiue, 135 -30, HM -2(15, 215. 323 -24 
orthogiiiial, 38-43, H'.l, 1115, 2112, 327 
in iJrinoiiial-axes wilulion, 473 5111 
rotation of; hoc Hotation of uxc.s 
Hefcreiico factors, 71-73, 85, (lu 

Ilnforoiice frame (nee altio Rurerencti uxes: 
Heference vectors) 
arbitrary, >J3-'J(i. 1111-24, 134. 327 
choice of, 177- 7(1, 281-85 
and correlated factors, 13il 40 
criteria for locution of 
analytical, 35(1, 377 -78 
Kruriliical, 108, 331-35 
statistical, 177-81 

centroid method, 327, 

eiTcct on 

of factoring method, 303 
_ of sign reversals in /'-matrix, 00 
inUotenninacy of location of, 473 -74 

'"uilKW ‘.(3, OS, 

vi-ix, 4.3, 135 HO, 215, 32.3 ^-l. 

orthogonal, 38 43, 137, 130, 251, 327 
in iirlnciiial-axes solution, 473 -r )10 
relation to 

of correlation matrix, 02 
of factor matrix, 78, 01-02 
rotation of; see Hotation of axes 
in simple structure, 327-28, 334 - 35 , 377 
Heference traits, 54-56, 130 


Hefei-mice vectors {,wc also Heference uxm. 
Heference tramc) '-"'■Baxca; 

adjii-stmeiit of, lon 
bipolar, 3!IO-()8 
eeiilriiid, 327 
elioice of axes as;, 323 -21 
cosines of, 227 

direcfioii cosines of, i;i2.38 lo-i n,. 

U27-28,2o1,3I7,;110-.51 ■ 

long. 100 2(15, 227 20, 2-11 
jm-silive, 300 *18 
Itrimary, 300-100, 422 

rcsidiml, 308 
trial, 378-85, ,300 401 
unit, 87, 00, 13.0, 10.5 no, 381-85 
Hellcetion of test vectors, 05-07 Me l -'.iL 

Hegressinn eipmlioiis 
in iterative iirncednre, 400 -.loo 

1)8,170, 

for !• on n, 400- .TOO 
for s on r, .51,>-I5 
for slopti of regre-s-sion line, 400 
weights ill, .50 111, 511-10 
for .roll H, ,511-15 
Heliiihility 
eocllichoit, 83 8(1 
ns diagonal entry, 83, 481 
and error variiiiu'e, 81 
nobUion for, 85 8(1 
perfeet, 474 

coiniiiiirmlity, 83-85, 282, 

of te.st. 83 80 
Hesidiial-s 

centroid-fuclor, 1.53 57. 1(13-(I5, 178 
in diagniml niethod of faetoring, 111 
elfcet of rulleelioii on, 153 -,57 
geiiernl-faelor, 473 
geoiijctrienl intcriiretatioii of, 165-57 
nuniyiiaiiig of, W)~ 01 , 82, 140, 177-78, 

principal-factor, 177-70, 473-74, 481- 
85, 403 -07 
zero, 295 

Heveiwls, sign, 05 ()7, MO, 153-57, 105- 

Kohinson, ( 1 ., 45 
Hoots 

of clmracliiristic iniuntion, 44-45, 477- 
70, 183 81, 487-01, 404 07, 500-503 
m jiolyiioinial, 11 45 
Hotation of axes 
adjiiHtnient of planes in, 241-51 
check on linear indcpciiucnco In, 239-40 
cnin])utatiunal formulae for three rota¬ 
tions, 205 

computational procedure for, 104r-216 
corrections in, 208-12, 248 



INDEX 


531 


and entries of factor matrix, ix, xi, 181- 
82, 292 

invariance of scalar product under, 91, 
09 

in method of extended vectors, 241-58, 
377, 400 
methods of 
double-group, 408-10 
minimizing weighted sums, 306-408 
by plotting on sphere, 131-39 
single-plane, 216-24 
successive approximation, 378-96 
by three-dimensional sections, 195, 
225-39, 377 

by two-dimensional sections, 194-95, 
224 377 

oblique, 43, 131—39, 104-224 
orthogonal, 38-43, 108-10, 202 
from orthogonal reference frame to prin¬ 
cipal axes, vUi, 280, 474-77 
purpose of, 101, 197, 292, 325-26 
to simple structure, 181-82, 225, 258, 
343, 508 

size of cosines and choice of, 241 
in three dimensions, 131-30, 194-224 
in two dimensions, 108-10 
use of principal-factor matrix in, 609 
How vector, 14 

S-matrix _ 

in rotation of axes, 197-205,227-29,241 
of scores, 08, 71, 77, 86, 93, 504-5 
Sampling errors, x, 200-61, 264, 267-68, 
283, 361 

Sampling theory, xii, 209 
Saturations: see Factor loadings; Projec¬ 
tions of test vectors 
Scalar, 23 

Scalar product of tost vectors 
correlations as, 89-91, 449 
defined, 37 
notation for, 380 
theorems on, 91, 94 
Scale 

of direction cosines, 137 
normalized, 367-69 
Science 

fundamental principle of, 291 
ideal constructs in, 61-55 
nature of, 61-55, 332 
of psychology, 52, 338 
unique solution in, 332 
Score functions, 319-27, 366, 368-72 
Score matrix 

element of, 68 ^ , 

factorial analjrais of, 68-71, 604-6 
notation for, 71, 86 
relation of 

to correlation matrix, 77, 93 
to factor matrix, 71 
to population matrix, 71 
anspose of, 77 


Score surfaces, 321-24 
Scores 

composite, 327 

condensation of, 177-79, 503-8 
defined, 62, 73 
derived, 63 
deviation of, 323 

functions for, 6&-69, 319-27, 365, 368- 
72 

as linear combinations of scores on cor¬ 
related primary factors, 356-58 
normalized, 64-06, 367-69, 448 
prediction of 

factor scores from test, 511-16 
teat scores from factor, 516-16 
processes underlying test, 503 
raw, 63-67, 823, 367-69 
reproduction of original, 284 
adected for factorid study, 319 
standard; tee Standard scores 
standard deviation of, 323, 368, 443-50 
summation, 442-43 
ti’ansformation of, 367-76 
true factor, 611 
true test, 62 
variance of, 86 
Scoring formula, 367 
Second-order factors 
defined, 411 

diagrammatic representations of, 416- 
20 

domain of, 411-14, 420-22 
factor patterns for, 418-19 
general, 421-34 
interpretation of, 416, 434, 436 
notation for, 411-14 
number of linearly independent, 414 
occurrence of, vii-viil, 411 
parameters oi, 411-16, 434-39 
physical example of 

four -dimensional, 427-34 
three-dimensional, 416-16 
relation to first-order factors, 411-39 
and tetrad, 272 
theories of, 439 
transformation for, 421-27 

Sectioning of matrix, 301—4 
Sections 

three-dimensional, 195, 226-39 
two-dimensional, 194-224, 377 

Selection 

complete, 470 , j a, jo 

dwendence of test scores and, 441—43 
e&ct of 

on oommunalities, 450-53, 46o 
on correlations, 4^60, 462-55 
on dispersions, 443-47, 4M, 4^65 
on facteisJ results, 55 , 326, 332-33, 
360-61, 412-13, 438, -^0-72 
on primary factors of, 46fr-M 

on simple structure of, 46fr-W 

geometrical representation of ''44-46 
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Selec 111 in— r.onlimml 

inultivurintc, •M3-14, •lft‘J-72 
partial, 471 
total, 471 

Otia-Kcllov fnnnulft mi ruHtriiilffil, 44!)- 
51) 

partial, 470 

rentrti'.tcil, 440--,W 

tcHtH, 44»-r)H, 4f)S, 4fl4, 470 

total, 470 -71 

typfiH of, 440 

uiiivariato 

roiiipleto, 443, 450, 45!l 111, 470 
partial, 443, 45!)-(i4 
viirialila, 443-.53, 4.5S, 4(>'}, 470 
iSelf-corroltttimi of test, f)tV !)7, 352 
t>i|i;ii-clianKinj.t motliodK, !)r)-!'l7, 140, 153 - 
57, 105-00 

Siiitjilc coiiriKiirution, fiS, 323; sir also Siiu- 
jile sti'iietiiro 

Him] lie order, 320-21, 328-20 
Hiin]tl(! Htriictiirc 
ulturiiativu, 320 -31 
licst-litliiiK, 355 
hitiolar, 180-03 
coiiijibtc, 301, 303, 378 
ciiiK'opt of, V, 58, 181-82, 310- 40 
cniiliKUraiiotial typuH of, 184 -03, 507 
uriteria 5ir, 331-10, 355--50 
dcliiiud, IHl, 328 
(jolurniiimey of, 301, 303 
ofTeot on 
of Hclnctiori, 440 
of treatiiumt of aeiirua, 300 
CKliiatioii of otiliqiic, 351-5,5 
Keonictridal iiiterpretiiUon of, 327-20 
Kruphieal iiidii'utioiiH of, 247, 250 58, 
335, 340 

liyjicrplttTies of, 327-28, 331, 335 
ineoiniilute, 210, 303, 378 
iiiterjirntatiim of, 324 
and invariance, 3(10-07, 450-04, 400 71 
isolation of, 181-82, 327-34, 343 
locatini; rcfni'cncc fniinc for 
analytical, 350, 377-78 
graphical, 247, 257-58, 334-3(i, 340, 
340 

oblique, 328, 354-50 
orthogonal, 247, 328-20, 352 
overdetcrminatiim of, 182,210,320,301, 
303-04 
poHitive, 342 

and positive iimnifold, 341- 44 
lirineipal-axc.M solutiiin verMiiN, 503, 508-• 
10 

purjiosc of, 332-33 
in r dimcnsiiins, 327-20, 347 
rotation to, 181-82, 22.5-58, 343, "HIH 
snbspaoos in, 327-28, 347, 377 
uniqueness of, 320-40 
vector model of, 120 

Simplified centroid method of factoring, 
159 


‘Simplijird MuUiplo b'nctor Method, bv L T 
Thurstone, 150 ^ 

Siniiiltnnnmis ciiuations, 13-18, 201 , 476 
Siiiglc-ctimmon factor, 2.50-81, 284, 487- 

SinglO'fntitor forinnin of ,Si)oartnan, 273- 
70,270-81,281,305 ' 

Single-factor uietbnd 
aiiiliigiiity in, 208 

of direct .sniiitiiation method, 277-78 
limitaliotiH of, fur innltiple-factor anal- 
ysi.s, 270-81 

log;irithmic .Holiitiim fur, 277 
aingle-fttclor formula in, 273-76, 284 
305-0 ’ 

of .Spearimm, v-ix, 250-08, 272-70 
of sueccfisive apjiroximutions, 278-70 
tetrad differences procedure as, 205-68 
Siiigle-iilaiie method of rotation, 210-24 
Sisatn, C. H., 1 
Skewness, 04, 307 
Slojin of a line, 33, 400 ■,5(K) 

•Snyder, V., I 

•S'oliVi Amlylical Ominrtry and Delemin- 
nuls, by Arnohl Dresden, I 
•Spneo 

augmented, 421 22 
common-factor; see Cmnmon-factor 
space 

error-factor, 73 70, S-l-SO, 140 
total factor, 176 
total test, 1)8, 176, 324, 421) 
nniipm-factor, 73 -7(1, 70, 86, 177 
■Simee fuelor, 145, 324 -26, 515 
.Speariiian, Charles, v-ix, 1.88,2,50-70,289- 
03, 305 (!, 421, 4:i0, 473 
.Spi'eilie-fuetor varitinee, viii, 75, 84-85; see 
also .Specilieity 
•Speeifie fuetor-s 
absence of, 84 

eliange from eimimim to, 361 
coiilribntiim of, 7!) 
defined, 73 
separation of, 287 
of .Siiearmiin, 272-73 
ill total vai'ianee, 73-76 
Kpecilicity 
defined, 75 
estinialioM of, 81 -85 
in factor mat rix of unit rank, 2(iK 
notation and terminology for, 85 
separation from error variance of, 84, 
2H7 

•Sjihericdl model, 125~‘13 

Hiihorical triangle, 130, 134, 147-48, 344, 
364 

Sipiuro root, calculation of, 45-46 
Squaring process in principal-axes solu¬ 
tion, 484-07 
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Standard deviation of distribution, 323, 
308, 443-rin, 454-rjf5, 46r)-66, 470 
Standard error, 261, 267-08 
Standard scores 
in abilities, 63, 70, 511-12 
in correlated primary faotora, 3,50-58 
distribution of, 04-00, 368 
linear form of, 68-60 
matrix of, 68, 71 
normalised, 64, 308, 448 
notation for, 85 
reduction tt>, 64-00, 368 
surfaces for, 323-24 
in tests, estimated from standard score 
in ability, 51.'>-16 
in unitary factors, 343 
Statistic, 414 

Staliilical Conjluence Annlyais by Means of 
Complete Reoresaion Syslema, by Rag- 
nar Frisch, 514 

Slalialioal Reaumd of the Spearman Two- 
Factor Theory, by Karl J. Hohinger, 
207 

Stephenson, William, 271 
Street Gestalt Completion teat, 333 
Stretching factor, 64, 132, 324, 381, 448, 
455, 484 

Structure, factorial 
compelling, 335, 378 
deOned, 87, 170, 181, 327-28 
oblique, 347-59 
simple; see Simple structure 
Subjects of expcrimontol population, 324- 
26, 360-01, 440, 470-72 
SubspacoH, 327-28, 347, 349, 377 
S\incessivc approximation method of rota¬ 
tion, 378-90 

Successive ai)proxiination method for unit 
rank, 278-70 

Summational procedures in i,. j * 

centroid method; see Centroid metnou oi 
factoring 

determination of single-common factor, 
277-78 

estimation of communalitios, 
grouping method of factoring, ill-lo, 
140 

Surfaces, score, 321-24 
Syllogism test, 326 
(Synonyms tests, 338, 608 

Temperamental traits, 322-24 

Test batteries __ 

as exploratory domains, 67-5o, Oo-iu, 
325, 333. 606-8 „„„ „„ 

factorial invariance In, 332-33, doi-or, 
373-76 

indeterminacy in, 378 
Test ooefBoients, 68-69, 71-73, 88 


Test score; see Scores 
Test vectors 

angular separations of, 93, 344-46 
centroid of, 151-63 
configuration, of; see Configuration 
cons^atlons of, 184-86, 297-99, 301, 
314, S44r46 
defined, 87 
equation for, 148 
extended, 226-68 
geometrical models 
three-dimensional, 125-48 
two-dimensional, 87-100 
length of, 91, 99 
as linear combinations of 
primary vectors, 127-30, 362-53 
reference vectors, 147-48 
normalized, 131, 379, 401, 448 
null, 175, 181, 336, 459 
plotting of normalized, 131-39, 194r-96 
m positive redon, 342 
projections of; see Frojectiona of teat 
vectors 

properties of, 87-97 
reflection of, 153-67 
scalaT product of, 89-91, 99 
in second-order domain, 422 
in simple struotuie, 181, 338-39 
unit, 91, 94, 127-28, 131 

oon^lexity of, 320, 326, 328, 333-35, 

composite, 69, 268, 327, blirAb 
correlation between, 67, 63, 76-82, 89- 
91,96 . , 

oorruation with primary factors of, dZ? 
defined, 02 

effect of selection of, 364, 440 
factorial composition of 
invariance of, 326-26, 333, 360-63, 
372-76 

prediction of, 333, 306, 606-8 
geometrical interpretation of, 87, 99 
notation for, 80 
number, 73, 146, 333, 361-62 
number of, to determine oo^on fao- 
tors, 82, 97-98, 262-65, 291-94, 307- 
11,440 
parallel, 83 

parameters of, 326. 332-33 

personality, 32^^ 

primary traits in terms of, i«8 
psychological nature of, 326 
pure, 361-52 

relialcility of, 83-^, 280, ^^4 

with saturations m several factors, dzis 

327 

scores on; see Scores 

in tetrad difference equation, 206 
use of, 326-27 ... 

validity coeffiolente of, 327, 81B 
variance of; see Vaiianoe 
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Tests—co»riin?«!rf 
verbal, MS, 333, 338, 3fil-fl2 
wciKhts of iJriniary niciitiil abilities for, 
(W, 3111 

Tetrad dllTcrenccs jiroreduri! 
characteristics ol, 2(15-(i«, 274, 2 !) 3 , 430 
iliftgoiial elements in, 200 , 284 
equation fttr, 26S-fifi, 273, 2113 
matrix interpretation of, 200 , 270 
Tetrads 

evaluation of, 2 ii 8 , 270 
Rraphical analysis of, 27()'72 
number of, 26,S-?!) 

relation of, to second-order ininors, vi. 
266-67 

of subgroup in correlation matrix, 271 
vanishing, 266-68, 270-71 
Theory <\f Multiple Factors, hy I,. L. Thiir- 
stimo, 175, 273, 277, 282, 473 
Theory of single common factor, 272 
Theory of two factors, 271-73 
Tliomson, Godfrey II., ix, 2n!) -70. 283. 

287-!)l, 443-60, 470 
Time limits, 367 
Trace of 

correlation matrix, 287-86 
piano, 1(17, 206-10, 220-2(1, 232 IT. 

Trait configuration, 327-28, 334-35, 344 • 
45 


Trait vectors; see Tost vooUirs 
Traits (see also Teats) 
clusters of, 126-27 
configuration of, 327-28, 334-35 
correlation lictwoen, 146, 322 
defined, 62 
description of, 54-5,5 
descriptive categories as, 328-2(1 
genetic basis of mental, 333 
8 c<>nictrioal interpretation of primary, 
349-50 

personality, 322-24 
primary, 847-62 
reference, 54-55, 130 
temperamental, 322 


Transformation 
determinant of, 40 
direction cosines for, 38-43 
for group factors, 424-20 
infinitesimal ortliogoual, 313 
linear, 38, 301, 308 
matrix of, 38, 43,134-SO, 347 
inouotonic, 360 

131-30, 11)4-224, 347-.52, 

ortliogonal. 38-43, 100-10, 130-37, 202, 
231, 343, 352 424-25 
from orthogonal reference frame to prin¬ 
cipal axes, viii, 286, 474-77 
for second-order factors, 422-27 
of test scores, 368-69 


Trapezoid population, 427-34 
Triungulttr configuration, 184-87 102 
Triplet, 182 
Tryoii, Uoliert, .'114-1,5 
Tucker, Lcdyard U., xiii .fp 3 -- 
441, 1,51), 4()7, .500 
Turnbull, H. W,, 1 , ,512 
Twn-fttctor theory, 2(37, 271-73 


thiiipie factors 

ttiiil eominon factors, 73-76, 272-73 
coiitributimi of, to diagonal cells, 79 
defined, 182 ’ 

notation for, 86 
imstulation of, 73-76 
and unity in diagonals, 284, 280 
nnirpie vuriunci* 
ahsence of, 177 
deleriiiiniifion of, 286-87 
nlTct't of diagonal values on, 282-87 
error yarieiieo in, 74 , 84 
experimental depeiuloucc and, 441-42 
468 * 

in Heywood ease, 289-01) 
separation of coimnon.fiictor variance 

UnUi cnib 

spceifili variance in, 74 , 84-8.5 
Uniqueiivss 

und centroid melliod, 161 
of (!ommHiiulilic.s, 307-11, 317-18 
of configiirafiiin, 92 1)3, 96, 178-80. 203 
correetimi for, 146 -47, 208 
of factor solution, 03, 178, 181) 
of paniiiieters, 329-31 
of primary fuclors, 332-34 
of prini’ijml-uxes solution, 178, 474 , ,503 
of simple strucluro, 320-31, 334-40 
of teat; see also TJniiiuo variance 
complctiicnt of, 282 
duliiHHl, 75 
notation for, 85 

Unit of measurement, 367-68 
Unit rank 

correlation matrix of, vlii-ix, 259-81 
duigoiuil entries and, 259, 262, 274, 277, 

284-87 > . . , I 


factor matrix for, 2.59-02, 268, 285-86, 
280-90, 488 

fuctorittl riRluction to, 268 ^O, 285-88 
factoriug rmahods for, 266-68, 273-70 
lloywoml Riimi and, 280-01 
limit ing cuao of, 261 
minimum trace and, 287-80 
mimhor of tests for, 262-6,5 
in second-order domain, 412-14, 420-22 
submatricea of, 171 
theorems on, 200 - 02 , 200 , 200 


Unitary factors, 343-44 

Univariate selection, 365, 443-64, 470-72 
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Validity coefBcienta of tests, 327, 516 
Variables 

criterion for, 443-53, 458, 404, 470 
dependent, 69-02, 68,116,179, 504, 512, 
516 

in factor analysis, 57-58, 313, 320 
independent, 69-62, 68, 116, 179, 291, 
604, 511, 518, 616 
selection of, 443-68, 458, 404, 470 
unitary factors in test, 343 
Variance 
of scores, 80 
of a test 

common-factor; see Common-factor 
variance 

contribution of factors to, 73-76,340- 
41 
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